-- Logs begin at Tue 2022-08-09 11:39:42 UTC, end at Tue 2022-08-09 13:13:25 UTC. -- Aug 09 12:08:17.645367 dv-cinder-852369-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 12:08:17.654706 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 12:08:17 2022] *** Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: nodename: dv-cinder-852369-1-iscsi Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: machine: x86_64 Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: clock source: unix Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: pcre jit disabled Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: detected number of CPU cores: 4 Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: current working directory: / Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: detected binary path: /usr/bin/uwsgi-core Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: your processes number limit is 47680 Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: your memory page size is 4096 bytes Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: detected max file descriptor number: 2048 Aug 09 12:08:17.656753 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: lock engine: pthread robust mutexes Aug 09 12:08:17.657504 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: thunder lock: enabled Aug 09 12:08:17.657504 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 12:08:17.657504 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 12:08:17.695906 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: Python main interpreter initialized at 0x55b2bb3f89c0 Aug 09 12:08:17.695906 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: python threads support enabled Aug 09 12:08:17.695906 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: your server socket listen backlog is limited to 100 connections Aug 09 12:08:17.695906 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: your mercy for graceful operations on workers is 90 seconds Aug 09 12:08:17.696259 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 12:08:17.696332 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: *** Operational MODE: preforking *** Aug 09 12:08:17.696596 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: *** uWSGI is running in multiple interpreter mode *** Aug 09 12:08:17.696596 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: spawned uWSGI master process (pid: 80170) Aug 09 12:08:17.696796 dv-cinder-852369-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 09 12:08:17.697309 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: spawned uWSGI worker 1 (pid: 80177, cores: 1) Aug 09 12:08:17.697638 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: spawned uWSGI worker 2 (pid: 80178, cores: 1) Aug 09 12:08:17.697802 dv-cinder-852369-1-iscsi devstack@keystone.service[80170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 12:08:23.085245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:08:23.085245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: from cryptography.utils import int_from_bytes Aug 09 12:08:23.086073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:08:23.086073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: from cryptography.utils import int_from_bytes Aug 09 12:08:23.086512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:08:23.086512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: from cryptography.utils import int_from_bytes Aug 09 12:08:23.086632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 12:08:23.086632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: from cryptography.utils import int_from_bytes Aug 09 12:08:23.134138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:08:23.134340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 12:08:23.134420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:08:23.134497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 12:08:23.134497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] command line args: [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:08:23.134622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] command line args: [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 12:08:23.134829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:08:23.134954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 12:08:23.135040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ================================================================================ {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:08:23.135109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ================================================================================ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 12:08:23.135168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] admin_token = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] admin_token = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] config_dir = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config_dir = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] config_source = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.135979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] debug = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.136117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] config_source = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.136200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.136757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] debug = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.136757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.136912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.136912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_config_append = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_dir = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_config_append = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.137932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_file = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_dir = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.138887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.139879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.140295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.140467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.140603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.140681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.140805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.140885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141629 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.141890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] publish_errors = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.142879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] publish_errors = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] standard_threads = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.143938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] use_journal = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] use_json = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] use_stderr = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.144945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] use_syslog = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.145160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.145271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.145390 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] standard_threads = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.145502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.145612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.145721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.145831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.145951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.146063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.146177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.146289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_journal = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.146400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.146509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_json = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.146640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.146806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_stderr = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.146806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] use_syslog = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.147160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.147673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 12:08:23.147799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.147799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.148902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.149907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.150122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.150238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.156240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.156368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.156368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.156725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.157950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.158910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.159974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.160973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.161972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.162084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.162289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.162616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.163980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.164960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.165960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.166972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.167994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.168901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.169935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.170940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.171959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.172987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173102 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.173970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.174085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.174196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.179337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.179469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.179590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.179732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.179865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.179995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.180966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.external = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.181883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.password = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] auth.token = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.182916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.183883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.external = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.184890 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.password = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.185906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] auth.token = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.186938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.187939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.188980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.189884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.190918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.191918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.192969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.193089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.193208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.193321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.193440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.193619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.193794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.194021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.194316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.194479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.194636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.194776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.194913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.195992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.196991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.197984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.198968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.199937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.200951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.201947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.202927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.203915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.204938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.205192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.205325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.205457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.205598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.205732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.205870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.206939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.207882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.208989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.209791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.210890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.211880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.212899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.213872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.214941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.215918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.216937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] role.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.217910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] role.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.218991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.219128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.219261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.219393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.219526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.219756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.219895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.220870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.221869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.222854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.223971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.224110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.224252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.224418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.224559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.224704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.224894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.225982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.226932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.227854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.228794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.229980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.230928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.231073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.231228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.231377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.231545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.231713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.231870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.connection = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.232877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.233955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.234907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.235976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.236974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.237953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.239100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 12:08:23.240228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80178) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 12:08:23.246803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.247031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.247257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.249664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.249893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.250117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.257028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.259873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.285192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.285390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.286028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.286261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.336968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.337220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.386985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.387140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.387283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.387520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.451882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.452942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.453135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.453310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.475846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.476876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.477018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.477100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.477166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.477367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.477495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.477713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.487940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.488585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.500694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.500834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.500906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.501888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.502026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80178) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.502122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 12:08:23.519079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.519259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:08:23.519356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.519497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:08:23.519577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.519796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:08:23.519909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 12:08:23.520125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.520932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.521069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.532276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.532452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.532593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.532676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.532828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.532972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.533111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.533194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.539936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.540065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.543014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.543161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.543300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.543384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.543569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.543695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.543848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.543932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.544913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.545770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.568416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.568609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.569911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.570038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.570175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.570349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.574753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.574880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.575023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.575143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.575301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.575446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.581837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.581964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.582102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.582183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.586270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.586395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.586536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.586618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.586813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.586958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.587929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.588043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.588123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.588187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.603671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.603944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.604201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.604499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.607866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.608520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.611004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.611293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.611606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.611902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.615885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.616420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.618939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.619609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.622078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.622371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.622653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.622778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.622918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.622999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.623184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.623325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.623464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.623545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.623854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.624131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.639414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.639639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.639902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.640366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.640530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.640633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.640905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.641174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.647514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.648371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.649096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.649340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.649967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.650247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.652155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.652425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.652753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.653034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.653158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.653296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.653416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.653607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.653899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.654176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.664750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.665026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.665301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.665553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.665725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.665893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.665971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.666057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.666133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.666361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.666498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.666653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.666901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.667174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.682929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.683635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.685876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.686599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.688793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.689575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.690337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.691143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.691816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.692097 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.692404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.692660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.692962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.693240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.698759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.699669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.700357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.701314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.703290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.703578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.703828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.704119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.704243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.704532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.704814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.705092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.712279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.712599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.712873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.713316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.713608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.713961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.719613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.719892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.720166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.720435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.720724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.720848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80178) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 12:08:23.720970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.721975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.722928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.723055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.723136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.723297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.723568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.723827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.724094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.724350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80178) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 12:08:23.756558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2bb3f89c0 pid: 80177 (default app) Aug 09 12:08:23.757558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b2bb3f89c0 pid: 80178 (default app) Aug 09 12:08:23.759805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2f785-3821-4f19-90f8-f5bdef46902b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:23.760082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2f785-3821-4f19-90f8-f5bdef46902b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:23.760345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2f785-3821-4f19-90f8-f5bdef46902b None None] PATH_INFO: `/v3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:23.764661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Tue Aug 9 12:08:23 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:31.405695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.406612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.406612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.413418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:31 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:31.420183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:31.420660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:31.420777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:31.501435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: INFO dbcounter [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] Registered counter for database keystone Aug 09 12:08:31.523734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG oslo_db.sqlalchemy.engines [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:08:31.535597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writer thread running {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:08:31.717144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG passlib.handlers.bcrypt [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80177) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 12:08:31.717445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG passlib.handlers.bcrypt [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80177) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 12:08:31.773077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:31.774668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:31.919032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 12:08:32.096123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.170353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: INFO dbcounter [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] Registered counter for database keystone Aug 09 12:08:32.194908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG oslo_db.sqlalchemy.engines [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80178) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 12:08:32.206094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writer thread running {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 12:08:32.333722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40fa60-45ea-48c8-9453-c3b97b3c794c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.339677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.340300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.340590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.340878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.350694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.404017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING keystone.common.rbac_enforcer.enforcer [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 12:08:32.404350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a8205-8aaf-49dd-be27-f04c15db24e7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.417010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:08:32.426466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:32.447711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6a0e5-ff00-477e-8313-f6bc4e03d226 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:32.453484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:32.454594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:32.454872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:32.455128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] PATH_INFO: `/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:32.456640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] RBAC: Authorizing `identity:get_project(project_id=865c26d1046a4242bbaffa7d1b6dfc7e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:32.506882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 12:08:32.507216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139322a-35f2-4339-acaf-cfee03c4fa7d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:32.511795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Tue Aug 9 12:08:32 2022] GET /identity/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:34.462629 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ba48-a568-4cf1-8782-b485f7d1c4d2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.463501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ba48-a568-4cf1-8782-b485f7d1c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.463501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ba48-a568-4cf1-8782-b485f7d1c4d2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.470336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:34.478105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.478558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.478647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.501749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:34.503239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:34.512073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 09 12:08:34.534725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ba48-a568-4cf1-8782-b485f7d1c4d2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.550082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ba48-a568-4cf1-8782-b485f7d1c4d2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.555061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e9bd0-5945-41a2-b81c-986848cca06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.555662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9bd0-5945-41a2-b81c-986848cca06f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.555938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9bd0-5945-41a2-b81c-986848cca06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.556211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e9bd0-5945-41a2-b81c-986848cca06f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.564082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9bd0-5945-41a2-b81c-986848cca06f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.565938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e9bd0-5945-41a2-b81c-986848cca06f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.575047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Tue Aug 9 12:08:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:08:34.583621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:34.598431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286c977-8c72-4a4a-8489-8ef1fbea8253 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:34.604935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf6625-4a7a-4b5f-a6d4-e1dec48cfcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:34.605551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6625-4a7a-4b5f-a6d4-e1dec48cfcba admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:34.605820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6625-4a7a-4b5f-a6d4-e1dec48cfcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:34.606082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf6625-4a7a-4b5f-a6d4-e1dec48cfcba admin admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:34.607512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf6625-4a7a-4b5f-a6d4-e1dec48cfcba admin admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:34.609362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf6625-4a7a-4b5f-a6d4-e1dec48cfcba admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:34.610870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Tue Aug 9 12:08:34 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:36.644885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044531-c95b-483c-a89b-c2a4f37f6040 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.645463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044531-c95b-483c-a89b-c2a4f37f6040 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.645463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044531-c95b-483c-a89b-c2a4f37f6040 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.646701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:36.652284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.652736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.652971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.671238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:36.672409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:36.705514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46260925-8e33-4755-9c27-dbdcb17bc3ff None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.705857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46260925-8e33-4755-9c27-dbdcb17bc3ff None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.706151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46260925-8e33-4755-9c27-dbdcb17bc3ff None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.707597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:36.713711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.713995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.714338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.760495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:36.761239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG passlib.handlers.bcrypt [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80178) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 12:08:36.761669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG passlib.handlers.bcrypt [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80178) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 12:08:36.783920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.807013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:36.808604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:36.808751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:36.893636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d812c-68fc-4bfc-98d9-1d120d6cc7a1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:36.911825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:36.926853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:36.927516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:36.927789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:36.928048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:36.933163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:36.939485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:36.948121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:36.949258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:36.950084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:36.960301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.049569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de5745-3233-4f54-bfde-c69d0e65c58c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.051592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.054982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.073696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9822ca6-1fab-4278-b854-b98fa589b01f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.096352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.097377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.097521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.097806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.108391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.109012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.109281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.109542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.110213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:37.110506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.111888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.125645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:37.131265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.183029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.184507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.304424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 8/16] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:37.310984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.314501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.392670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926a1b4-c1ab-4b15-9840-e4a12eb9ec61 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.441019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.441938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.442227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.442502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.443762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.444742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8d74c-9b02-41e0-8e12-146675a5201c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.445973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.447576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 9/17] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:37.453534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.469569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.484779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.486095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.486523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.486954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.509066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.510710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:08:37.532989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:37.533933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:08:37.534765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:08:37.534765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:37.534765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:37.534765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 9/18] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:37.542073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.573210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e013a-74f1-407c-a368-2bd2ae32e2e7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.607704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.608338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.608626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.608884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.609601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.610003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.611957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.613931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 10/19] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:37.621845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:37.658776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c59ec-2683-4e70-9b88-eee678b42dd6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.698432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.698974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.699250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.699519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.700170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:37.700502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.701901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1cc24-8d66-421e-8adb-0e6a20cdb366 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.714571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:37.723042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 10/20] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:37.739564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43a4c-4aae-4ea0-ad55-38af16bef0e7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:37.784519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:37.785132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:37.785405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:37.785673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:37.786448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.domain.id=default, user.id=881d465484874e7283e8dee880624ffb) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:37.786754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:37.788321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9a2f6-6153-4cf6-988f-1ad718cbc9e1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:37.797283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 11/21] 10.222.0.60 () {56 vars in 1322 bytes} [Tue Aug 9 12:08:37 2022] GET /identity/v3/role_assignments?user.id=881d465484874e7283e8dee880624ffb&scope.domain.id=default&role.id=1e154845d18647eaa8a61129c3419d62 => generated 233 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:40.156916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242938d-3f0c-4902-9b84-51084796bb05 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.157889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242938d-3f0c-4902-9b84-51084796bb05 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.158355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242938d-3f0c-4902-9b84-51084796bb05 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.159904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 11/22] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:40.177091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.177606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.177606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.191107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195434d-7dce-476c-88ef-69583a921c20 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.191720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195434d-7dce-476c-88ef-69583a921c20 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.192179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195434d-7dce-476c-88ef-69583a921c20 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.193716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 12/23] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:40.198867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7117-b3a2-40d7-b5a2-df4c70637cc8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.199389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7117-b3a2-40d7-b5a2-df4c70637cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.199843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee7117-b3a2-40d7-b5a2-df4c70637cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.203537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.204947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:40.227201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5bee7117-b3a2-40d7-b5a2-df4c70637cc8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.228656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5bee7117-b3a2-40d7-b5a2-df4c70637cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:40.326715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 12/24] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:40.345880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:40.364065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.365130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933213e-b022-41ce-9680-7c63c7f9f964 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.365412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933213e-b022-41ce-9680-7c63c7f9f964 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.365683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933213e-b022-41ce-9680-7c63c7f9f964 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.367688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 14/26] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:40.373920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.374441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.374875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.407126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.408243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:40.481290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.490433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.522473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb4dd3-40b1-46d9-b3a1-e5eba2478a37 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.523940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 15/27] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:40.524999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.565423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec626ae8-a1e6-4383-9ad2-9cbe82ed08e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.566420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec626ae8-a1e6-4383-9ad2-9cbe82ed08e3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.566699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec626ae8-a1e6-4383-9ad2-9cbe82ed08e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.566968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec626ae8-a1e6-4383-9ad2-9cbe82ed08e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.589904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec626ae8-a1e6-4383-9ad2-9cbe82ed08e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-ec626ae8-a1e6-4383-9ad2-9cbe82ed08e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:40.597171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:40.598103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:40.598892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:40.599528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:40.603440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503467-a554-4d49-8439-efe7c6b48652 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.603927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503467-a554-4d49-8439-efe7c6b48652 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.604698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4503467-a554-4d49-8439-efe7c6b48652 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.611519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 14/29] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:40.611519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503467-a554-4d49-8439-efe7c6b48652 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.658556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761f31f-236d-4623-bc9c-5f35724faca9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.706739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.707715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.708217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.709072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.721959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4503467-a554-4d49-8439-efe7c6b48652 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:40.722582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.724299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.760164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d54e87-3de4-4273-9a4e-b7040a768390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:40.761197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d54e87-3de4-4273-9a4e-b7040a768390 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.761671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d54e87-3de4-4273-9a4e-b7040a768390 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.762199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d54e87-3de4-4273-9a4e-b7040a768390 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.763087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d54e87-3de4-4273-9a4e-b7040a768390 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:40.764835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d54e87-3de4-4273-9a4e-b7040a768390 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:40.769982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:08:40.861405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:40.862365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:08:40.863256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:08:40.863256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:08:40.863256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:40.863256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 16/30] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:40.863463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:40.899106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:40.914793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 15/31] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:40.916666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:40.917171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:40.917645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:40.938449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:40.940328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:40.979373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ba2da-39b3-4f20-aadc-9fe2a5bed362 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.016713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 16/32] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:41.017919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.024081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.025163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.025674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.028095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.029081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:41.030261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.034877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.050672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 17/33] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.051988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.139547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28fabc-711a-4194-8903-8c13bf29b955 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.154590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.168661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5aae3-0b9b-46c1-bce8-a762149a7303 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.199813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.212578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.213664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.213911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.214373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.214538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.214934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.215130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.215551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.216371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.217321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:41.217758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.218308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.219621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.242948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 17/34] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.244135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.360890 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae26b-3e39-4d6f-aa83-616318847fff None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.374063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 18/35] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:41.375320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.415458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.417452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.418637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.419156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.422323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.424893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.427730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 18/36] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.437515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.510039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e702a0d-66bd-416b-b867-10f21fa885a9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.547724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d7412-932a-4a8d-aa7c-696d086db60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.548868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7412-932a-4a8d-aa7c-696d086db60b None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.549397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7412-932a-4a8d-aa7c-696d086db60b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.549905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d7412-932a-4a8d-aa7c-696d086db60b None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.551022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d7412-932a-4a8d-aa7c-696d086db60b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.552962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d7412-932a-4a8d-aa7c-696d086db60b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.564465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.596005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 19/37] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/projects => generated 301 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:41.615693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c4fa6-9500-48ed-aa99-648edb09076d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.616402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c4fa6-9500-48ed-aa99-648edb09076d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.616885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c4fa6-9500-48ed-aa99-648edb09076d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.618561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 20/38] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:41.622422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1164bf12-961f-4529-9fd6-97fca5b432be None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.625620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2158-82f0-4ba1-9917-bcf8b38d2ece None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.626158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2158-82f0-4ba1-9917-bcf8b38d2ece None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.626629 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb2158-82f0-4ba1-9917-bcf8b38d2ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.644790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.648225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3aeb2158-82f0-4ba1-9917-bcf8b38d2ece None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:41.650122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3aeb2158-82f0-4ba1-9917-bcf8b38d2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:41.673103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.673710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.673987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.674255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.675428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.677583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.679459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 19/39] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:41.686095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.745366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 21/40] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:41.772556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f4661-3e3f-47fc-a6cc-ee50113e932b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.772849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f4661-3e3f-47fc-a6cc-ee50113e932b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.773270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f4661-3e3f-47fc-a6cc-ee50113e932b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.775035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 22/41] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:41.781042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.781445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.781790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.802192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:41.803221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:41.820715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97eb373-fe42-44f9-9e13-31b0d95c5a6a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:41.842436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:41.858340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:41.859011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:41.859286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:41.859555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] PATH_INFO: `/v3/domains/default/users/881d465484874e7283e8dee880624ffb/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:41.861517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=881d465484874e7283e8dee880624ffb, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:41.862965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:41.877542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 23/42] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:41.888025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 20/43] 10.222.0.60 () {58 vars in 1361 bytes} [Tue Aug 9 12:08:41 2022] PUT /identity/v3/domains/default/users/881d465484874e7283e8dee880624ffb/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:41.888271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.901265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:41.963053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.013044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a4f34-70c6-468f-a75a-80554d3cc5e8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.015756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5524a31-fd09-4376-9df8-84c2b2acc3aa None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.056798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc08e5-5a5b-4243-99c0-d0f7476ef713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.057533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc08e5-5a5b-4243-99c0-d0f7476ef713 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.057882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc08e5-5a5b-4243-99c0-d0f7476ef713 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.058224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc08e5-5a5b-4243-99c0-d0f7476ef713 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.058970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc08e5-5a5b-4243-99c0-d0f7476ef713 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.060398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc08e5-5a5b-4243-99c0-d0f7476ef713 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.063092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.063743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.064023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.064293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.065490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.066958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.068580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 21/44] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:42.075321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:42.079603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 24/45] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 9 12:08:41 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:42.131280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:42.191061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c06b6a-36cb-4642-b2b2-47fade36ff0c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:42.227199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e2a72-27ca-4f0d-9072-57e0a44aa318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:42.227811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2a72-27ca-4f0d-9072-57e0a44aa318 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:42.228041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2a72-27ca-4f0d-9072-57e0a44aa318 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:42.228274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e2a72-27ca-4f0d-9072-57e0a44aa318 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:42.228966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e2a72-27ca-4f0d-9072-57e0a44aa318 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:42.230469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e2a72-27ca-4f0d-9072-57e0a44aa318 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:42.264016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 22/46] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:08:42 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:43.858706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36731f53-f596-47b2-b7d9-3917f9f4ddb4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:43.859290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36731f53-f596-47b2-b7d9-3917f9f4ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:43.859290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36731f53-f596-47b2-b7d9-3917f9f4ddb4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:43.860746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 25/47] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:43.866024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:43.866515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:43.866681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:43.885348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:43.886494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:43.955069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 23/48] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:43.981883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36731f53-f596-47b2-b7d9-3917f9f4ddb4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.088262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36731f53-f596-47b2-b7d9-3917f9f4ddb4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.110702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.125418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488d764-7efb-4c55-8a34-0dcd3b89bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.126065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488d764-7efb-4c55-8a34-0dcd3b89bf5a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.126340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488d764-7efb-4c55-8a34-0dcd3b89bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.126610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488d764-7efb-4c55-8a34-0dcd3b89bf5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.139318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488d764-7efb-4c55-8a34-0dcd3b89bf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9488d764-7efb-4c55-8a34-0dcd3b89bf5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:44.145589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:44.146572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:44.147452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 26/49] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:44.153816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.185788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.257356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd507d2-c644-42f2-b85c-84aab1323491 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.272266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f42a-3617-42bb-86eb-3382c2e70e19 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.272578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f42a-3617-42bb-86eb-3382c2e70e19 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.272912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f42a-3617-42bb-86eb-3382c2e70e19 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.274190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 27/50] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:44.278990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.279267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.279541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.293737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.294357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.294762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.294887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.295584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:44.295879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.297279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.297918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:44.299103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:44.306184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 24/51] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:44.311795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.366482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 28/52] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:44.388880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.402827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.412500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13284b6f-e9e3-4097-a1fa-7aeaa2f89b43 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.447763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.448437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.448709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.448980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.450158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.451608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.453305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 25/53] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:44.458907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.493119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac91e1-be25-4c6e-88b6-ef76a4ad76ec None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.506094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.529258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.529887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.530160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.530404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.531542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.533028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.534793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 29/54] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:44.541440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.561259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f194839-d4bb-4e45-9d04-5c25d97af3f4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.596885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.597520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.597794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.598060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.599158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.600966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.602567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 26/55] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:44.608269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:44.637931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:44.641316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257036a-30f0-4caa-b1c4-3ec741911ba3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.674232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ff47-c95e-4f51-a54b-aa8edc730808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.674842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ff47-c95e-4f51-a54b-aa8edc730808 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.675117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ff47-c95e-4f51-a54b-aa8edc730808 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.675386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ff47-c95e-4f51-a54b-aa8edc730808 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.676018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ff47-c95e-4f51-a54b-aa8edc730808 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.677497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ff47-c95e-4f51-a54b-aa8edc730808 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.705350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 30/56] 10.222.0.60 () {60 vars in 1140 bytes} [Tue Aug 9 12:08:44 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:08:44.710896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a54816-0baa-4a0c-9bb9-db3f17325743 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:44.749230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:44.749868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:44.750142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:44.750411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:44.751149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.domain.id=default, user.id=881d465484874e7283e8dee880624ffb) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:44.751456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:44.752993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f16fa-c732-4a74-bf56-33a5c877959e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:44.760412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 27/57] 10.222.0.60 () {56 vars in 1322 bytes} [Tue Aug 9 12:08:44 2022] GET /identity/v3/role_assignments?user.id=881d465484874e7283e8dee880624ffb&scope.domain.id=default&role.id=1e154845d18647eaa8a61129c3419d62 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:46.703641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa005ec-7766-4263-a322-9b11617b7f93 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.704194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa005ec-7766-4263-a322-9b11617b7f93 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.704194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa005ec-7766-4263-a322-9b11617b7f93 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.705600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 31/58] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:46.711813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:46.712491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:46.712748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:46.736643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:46.737835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:46.809853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 28/59] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:46.833840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa005ec-7766-4263-a322-9b11617b7f93 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:46.873614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:46.958363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa005ec-7766-4263-a322-9b11617b7f93 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:46.999981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf0d94-f0ba-4711-afb7-f394f57009cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:47.000908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0d94-f0ba-4711-afb7-f394f57009cb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.001234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0d94-f0ba-4711-afb7-f394f57009cb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.001556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf0d94-f0ba-4711-afb7-f394f57009cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.003482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0d94-f0ba-4711-afb7-f394f57009cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:47.005861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf0d94-f0ba-4711-afb7-f394f57009cb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:47.008350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 32/60] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:47.017115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:47.042863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:47.125293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728c0d9-2013-4164-afcf-cfb00562f07b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:47.161822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341898f-0fa8-43d4-a6ad-5c7a71d68b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:47.162426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341898f-0fa8-43d4-a6ad-5c7a71d68b34 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:47.162955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341898f-0fa8-43d4-a6ad-5c7a71d68b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:47.163565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341898f-0fa8-43d4-a6ad-5c7a71d68b34 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:47.164216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341898f-0fa8-43d4-a6ad-5c7a71d68b34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:47.165685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341898f-0fa8-43d4-a6ad-5c7a71d68b34 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:47.198336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 29/61] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:47 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:50.143243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021aa1d-0635-4c81-9538-b4a01fdb367f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.144225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021aa1d-0635-4c81-9538-b4a01fdb367f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.144752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021aa1d-0635-4c81-9538-b4a01fdb367f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.146300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 33/62] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:50.151880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef43a-fc8d-4cae-845b-1aacfd7fb95a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.152728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef43a-fc8d-4cae-845b-1aacfd7fb95a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.153194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdef43a-fc8d-4cae-845b-1aacfd7fb95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.181355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1cdef43a-fc8d-4cae-845b-1aacfd7fb95a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:50.182871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1cdef43a-fc8d-4cae-845b-1aacfd7fb95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:50.278972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 30/63] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:08:50.314012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021aa1d-0635-4c81-9538-b4a01fdb367f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.454539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.456310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf74c5-b0e0-4d6a-9552-e177cc3b6161 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.456862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf74c5-b0e0-4d6a-9552-e177cc3b6161 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.457319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf74c5-b0e0-4d6a-9552-e177cc3b6161 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.458408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021aa1d-0635-4c81-9538-b4a01fdb367f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.459276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 31/64] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:50.472566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560b1d5-951e-425f-ad39-d5d0419102da None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.473151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560b1d5-951e-425f-ad39-d5d0419102da None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.473490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560b1d5-951e-425f-ad39-d5d0419102da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.499487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.499487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.499487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.499487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.508478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:50.509573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4560b1d5-951e-425f-ad39-d5d0419102da None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:50.510856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4560b1d5-951e-425f-ad39-d5d0419102da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:50.513270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:50.515837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:50.516859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:50.518034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:50.521172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 34/65] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:50.534401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.639922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 32/66] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:50.642129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3e30-a3ed-475f-b81e-b46509f0beec None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.642646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3e30-a3ed-475f-b81e-b46509f0beec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.643106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3e30-a3ed-475f-b81e-b46509f0beec None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.644536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 33/67] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:50.652807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.653466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.653929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.678937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:50.680675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:50.690247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93077f-dd26-4603-97e2-c18ff1fcaf1a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.726589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.727444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.727725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.727997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.728908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:50.729211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.730783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.740194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 35/68] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:50.741594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.759596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 34/69] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:50.764583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.776735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.855857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:50.886379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b1b0d-9895-45a5-a3aa-56e8ab8cfb60 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.902345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3684cfe-e991-4074-94d4-b26ae3e27923 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:50.931595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.932249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.932558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.932832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.939868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fda42-400d-4318-89da-cf56dc133ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:50.940617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fda42-400d-4318-89da-cf56dc133ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.940817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fda42-400d-4318-89da-cf56dc133ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.941087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fda42-400d-4318-89da-cf56dc133ef3 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.943547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:50.949383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:50.950248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:50.951017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:50.951643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:50.959962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fda42-400d-4318-89da-cf56dc133ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:50.961892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fda42-400d-4318-89da-cf56dc133ef3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:50.964108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:50.965511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26186-6a2a-4570-9501-a67591f3b51c None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:50.965946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26186-6a2a-4570-9501-a67591f3b51c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:50.966328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc26186-6a2a-4570-9501-a67591f3b51c None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:50.967821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 36/72] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:50.968403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26186-6a2a-4570-9501-a67591f3b51c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.043775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.062072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f7e7-0d25-45e8-b006-3c9835031981 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.074091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc26186-6a2a-4570-9501-a67591f3b51c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.095994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.096645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.096923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.097196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.098304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.098625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.099790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.101637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 37/73] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:51.102395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.111515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.112136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.112438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.112713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.113383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:51.113688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.115078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425045bc-cdef-4425-8911-625aa3e908dd None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.123305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 37/74] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:51.124476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0132b-3536-4642-b5c9-3c0620ead138 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.124764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0132b-3536-4642-b5c9-3c0620ead138 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.125035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0132b-3536-4642-b5c9-3c0620ead138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.143256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e8b0132b-3536-4642-b5c9-3c0620ead138 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:51.144488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e8b0132b-3536-4642-b5c9-3c0620ead138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:51.206431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91cda0-9d4b-4f91-b4f2-3ed4ed0c9d3f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.212464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 38/75] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:51.214141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e0f73-9d44-42b4-bd6b-79533b4f7c33 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.214423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e0f73-9d44-42b4-bd6b-79533b4f7c33 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.214690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e0f73-9d44-42b4-bd6b-79533b4f7c33 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.216059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 39/76] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:51.216613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e0f73-9d44-42b4-bd6b-79533b4f7c33 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.247594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ae35a-52ec-417d-9a13-49b528400d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.248214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ae35a-52ec-417d-9a13-49b528400d4c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.248532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ae35a-52ec-417d-9a13-49b528400d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.248803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ae35a-52ec-417d-9a13-49b528400d4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.267559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.317212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ae35a-52ec-417d-9a13-49b528400d4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.318609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ae35a-52ec-417d-9a13-49b528400d4c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.331795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e0f73-9d44-42b4-bd6b-79533b4f7c33 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.349695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.368559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.369197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.369479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.369750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.370394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.371843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.394465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 40/77] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:51 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:51.394465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.420069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 38/78] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:51.421493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.421782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.422058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.441458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:51.442717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:51.492768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.515974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 39/79] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:51.516971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.536922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b252f-190a-48eb-aaba-9ad9bd773ad4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.578457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.579179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.579492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.579747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.580988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.582662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.584613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 41/80] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:51.585384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.638264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.649239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b3313-18ed-4c72-a9d2-b5ea2c435197 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.700031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.700230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.700578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.701376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.712943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:51.714425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fb7d3-4c3e-4d66-a4c4-b087ad0de950 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:51.717709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:51.718538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:51.719377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 40/81] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:51.720030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.750794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.751437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.751725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.751974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.753389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.754844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:51.756690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 42/82] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:51.757475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.776911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.852253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0ecb6-a70f-43ae-b72d-dfec0ff8d360 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.866055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f777495-38d6-4e05-87e0-1172b03d3cbb None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:51.876689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:51.893460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.894663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.895181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.895640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.907865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:51.911357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:51.912035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:51.912318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:51.912736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:51.914472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:51.915318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:51.916089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:51.918499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 41/83] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:51.919528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:51.986887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:51.988401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.038436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.043123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8fdcd-4889-4061-9b12-548f0b8f5530 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.084802 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.085449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.085760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.086440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.086815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:52.087118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.088535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.102003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.102003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.105224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 43/85] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:52.106157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.121136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.221645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df9827-e607-4b2b-ae7d-222da1e61a62 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.236070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12b75a-6dd5-4288-a297-15f836fc74b0 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.258579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.259468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.259906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.260362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.261280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=18129a6b85244d64a5bd0a61709b90f7) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:52.261781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.263401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.272982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 43/86] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/role_assignments?user.id=18129a6b85244d64a5bd0a61709b90f7&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.281166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.286441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.287084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.287426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.287739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.288537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:52.288839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.290279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.308459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 44/87] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.309669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.330094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.419747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb180e-e0bf-4c73-8d26-cbd85020d0aa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.459547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.461110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.461531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.461925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.463512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.465176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.467312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 44/88] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.468499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.514482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.558050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1114143-d5a4-4df5-a386-c94411e30c4d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.585926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.593671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798857d-1d98-4293-bff2-f4b1014da285 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.630172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.630985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.631365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.631712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.632345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.633178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.633605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.634022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.635313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.636930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.637182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.638708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.639042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 45/89] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.640603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.641371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 45/90] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:52.645501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:52.811105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503327b8-65db-44b0-acba-3fa428ce5ff9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.847353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.848318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.848792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.849230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.863276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536dab-5372-480a-8323-52f4e2633274 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:52.880767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:52.920409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:52.922297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:52.942135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:52.942795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:52.943035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:52.943304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:52.958926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.026135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 46/91] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:53.027302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.072543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.073772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.100309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.131052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b869c6e-e458-4df5-9b37-20b084947b56 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.169389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.170301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.170749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.171209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.172107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=881d465484874e7283e8dee880624ffb) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:53.172614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.174232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.180422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/role_assignments?user.id=881d465484874e7283e8dee880624ffb&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:53.181747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.258885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 46/93] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:08:53.264780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.292931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dce61c-1bd6-46f9-b8e8-d9400d869e73 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.322723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.336782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.338142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.339156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.339617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.340073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.341609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.343291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.345153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 48/94] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:53.362927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.404186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c983bdb-0fba-4573-860e-3eb44868d659 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.448424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.448424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.448424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.448424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] PATH_INFO: `/v3/projects/8fbed2591da64310bc85a35017b191d9` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.448812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] RBAC: Authorizing `identity:get_project(project_id=8fbed2591da64310bc85a35017b191d9)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.448812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.449727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 47/95] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/projects/8fbed2591da64310bc85a35017b191d9 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:53.454716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:53.565857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646a915-cf62-4a26-8507-f02ed75408c6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.617823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.618354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.618626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.618894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.619637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] RBAC: Adding query filter params (role.id=d4751935dff54d9f83198053a192832d, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=18129a6b85244d64a5bd0a61709b90f7) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:53.620359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.621825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60169dd8-7537-4330-a589-e523105b83f5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.632712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d8d62-c81c-4ffa-a4a0-759418142631 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:53.635834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 49/96] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/role_assignments?user.id=18129a6b85244d64a5bd0a61709b90f7&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=d4751935dff54d9f83198053a192832d => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:53.645218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:53.682629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:53.683252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.683526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.683792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.684562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=8fbed2591da64310bc85a35017b191d9, user.id=18129a6b85244d64a5bd0a61709b90f7) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:53.684870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:53.686353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d141de-8d08-47ad-86aa-eb8257307504 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:53.697362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 48/97] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/role_assignments?user.id=18129a6b85244d64a5bd0a61709b90f7&scope.project.id=8fbed2591da64310bc85a35017b191d9&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:53.785531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2045f6-c610-4c0d-bc83-bc07ba866b6e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.785531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2045f6-c610-4c0d-bc83-bc07ba866b6e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.785531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2045f6-c610-4c0d-bc83-bc07ba866b6e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.785531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 50/98] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:53.792347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:53.793009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:53.793468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:53.813549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:53.815159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:53.907865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 49/99] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:53.946073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2045f6-c610-4c0d-bc83-bc07ba866b6e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.009302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:54.053650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2045f6-c610-4c0d-bc83-bc07ba866b6e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.087940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b64830-ec5c-47a2-846b-ec121071a2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.088602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64830-ec5c-47a2-846b-ec121071a2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.088878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64830-ec5c-47a2-846b-ec121071a2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.089145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b64830-ec5c-47a2-846b-ec121071a2c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.090281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b64830-ec5c-47a2-846b-ec121071a2c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:54.091874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b64830-ec5c-47a2-846b-ec121071a2c2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:54.093567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 51/100] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:54.099535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.208458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae35c-d670-4675-8c92-4869acba667e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.210009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:54.255431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.256054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.256358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.256656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.257297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:54.258742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:54.276312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c552-5708-4282-b826-e9116658765e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.276638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c552-5708-4282-b826-e9116658765e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.276890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8c552-5708-4282-b826-e9116658765e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.278372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 52/101] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:08:54.283293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.283569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.283835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.303561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:54.304786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:54.332566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 50/102] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:08:54 2022] POST /identity/v3/projects => generated 302 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:54.420239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 53/103] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:54.455557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.576623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afb0d8-b9ea-4fb8-8dff-17d91aafbd47 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.613403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.614050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.614324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.614594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.625808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:54.631296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:54.632175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:54.633036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 51/104] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:54.640129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.727873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:54.783074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84df4b-4847-492f-b3e6-4f0fe9e48c02 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:54.829424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:54.830313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:54.830800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:54.831234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:54.837113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:54.837633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:54.839216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:54.848315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 54/105] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:54.854263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:54.879846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:54.977357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490f9ab-0633-4857-be28-33ede47ea689 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.011320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.011968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.012246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.012551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] PATH_INFO: `/v3/users/8c71f1f6cc244b3f9469f78f36e264de` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.027783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] RBAC: Authorizing `identity:get_user(user_id=8c71f1f6cc244b3f9469f78f36e264de)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.029323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.031026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 52/106] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:54 2022] GET /identity/v3/users/8c71f1f6cc244b3f9469f78f36e264de => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:55.041561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.185751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6b8d3-9bac-4fe3-bd9d-414883953a22 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.212943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.234234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58eae1-07ac-437d-9829-dc053cca9d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.235129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58eae1-07ac-437d-9829-dc053cca9d0d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.235538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58eae1-07ac-437d-9829-dc053cca9d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.241223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58eae1-07ac-437d-9829-dc053cca9d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.321850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58eae1-07ac-437d-9829-dc053cca9d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.323973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58eae1-07ac-437d-9829-dc053cca9d0d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.450728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 55/107] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:08:55.456564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.573549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.613096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14591b4-0597-461e-a9d7-48a80240b42e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.664759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd7c60-746f-4360-a94c-e25d6ad66fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.665760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7c60-746f-4360-a94c-e25d6ad66fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.666227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7c60-746f-4360-a94c-e25d6ad66fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.666701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd7c60-746f-4360-a94c-e25d6ad66fc0 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.670420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7c60-746f-4360-a94c-e25d6ad66fc0 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.671465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1bd86-52ee-4dfd-ab0e-a8a77fe6bca9 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.671754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1bd86-52ee-4dfd-ab0e-a8a77fe6bca9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.672027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1bd86-52ee-4dfd-ab0e-a8a77fe6bca9 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.672735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd7c60-746f-4360-a94c-e25d6ad66fc0 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.674580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 53/109] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:55.674784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 56/109] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:55.680002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.680556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.681014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.681132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1bd86-52ee-4dfd-ab0e-a8a77fe6bca9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.707851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:55.709451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:55.717524 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:55.874665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 54/110] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:55.881627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1bd86-52ee-4dfd-ab0e-a8a77fe6bca9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:55.907673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:55.941596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:55.942209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:55.942485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:55.942751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:55.943583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] RBAC: Adding query filter params (role.id=f573691e90cc403d9084314ae7ee8b01, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=8c71f1f6cc244b3f9469f78f36e264de) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:55.943936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:55.945466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:55.957275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 57/111] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/role_assignments?user.id=8c71f1f6cc244b3f9469f78f36e264de&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=f573691e90cc403d9084314ae7ee8b01 => generated 259 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.039883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.078480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2be751-354f-45a2-923c-d75c6241a7e0 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.122714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d62dfa-fd47-4241-8790-bc94219515f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.123365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62dfa-fd47-4241-8790-bc94219515f3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.123641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62dfa-fd47-4241-8790-bc94219515f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.123906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62dfa-fd47-4241-8790-bc94219515f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.141964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d62dfa-fd47-4241-8790-bc94219515f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-b5d62dfa-fd47-4241-8790-bc94219515f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:56.148103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:56.148988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:56.149748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 55/112] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:08:56.155156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.287365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.312635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bea82-2f8d-4308-a7fb-00e39ec03c1a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.324419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c55690-162c-49c2-89d2-9db2a32b981b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.324805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c55690-162c-49c2-89d2-9db2a32b981b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.325077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c55690-162c-49c2-89d2-9db2a32b981b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.326947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 56/113] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:56.332862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631831-efe6-4464-ba93-41704daad295 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.333409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631831-efe6-4464-ba93-41704daad295 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.334072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631831-efe6-4464-ba93-41704daad295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.368664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a9631831-efe6-4464-ba93-41704daad295 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:56.370907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a9631831-efe6-4464-ba93-41704daad295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:56.378316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.379590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.380056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.380550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.381508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:56.382004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.388071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b93f2-40bc-40fc-986e-a7eb0c5115a8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.400885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 58/114] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.404099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6127963-2eb9-42dd-a26b-7754e0329726 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.409252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6127963-2eb9-42dd-a26b-7754e0329726 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.410599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6127963-2eb9-42dd-a26b-7754e0329726 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.414991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 59/115] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:56.419606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6127963-2eb9-42dd-a26b-7754e0329726 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.503824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 57/116] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:56.508697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.509188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.509778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.541099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:56.544141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:56.594395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6127963-2eb9-42dd-a26b-7754e0329726 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.648093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.657764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.658609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.658884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.659158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.661302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.664105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.665749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 60/117] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.668995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.670747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 58/118] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:56.671694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.698193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:56.792134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22265433-c77e-45ce-b389-8f8480909c96 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.857247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.857804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.858075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.858338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.860039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:56.861510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:56.863304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 59/119] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:56.868052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.873760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034b0f4-971a-4b01-a742-9d4bcb478e7a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:56.923439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:56.924318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:56.925500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:56.925782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:56.938920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:56.946021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:56.946897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:08:56.947666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 61/120] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:56.948835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:56.955851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.007252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a1d9c-2043-4239-8c8e-7357a4ede27d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.037992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.048586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb4f3-8b9a-45ae-9af2-b3cb8e395dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.049235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb4f3-8b9a-45ae-9af2-b3cb8e395dad None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.049876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb4f3-8b9a-45ae-9af2-b3cb8e395dad None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.050161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb4f3-8b9a-45ae-9af2-b3cb8e395dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.063259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfb4f3-8b9a-45ae-9af2-b3cb8e395dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d9cfb4f3-8b9a-45ae-9af2-b3cb8e395dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:57.070366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:57.071420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:57.072372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 60/121] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:08:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:57.073099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6a690-88c9-40f4-80f1-13decbf228b5 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.073099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6a690-88c9-40f4-80f1-13decbf228b5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.073309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6a690-88c9-40f4-80f1-13decbf228b5 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.076456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 61/122] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:57.077414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6a690-88c9-40f4-80f1-13decbf228b5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.083488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29368d77-f0c1-4991-b015-0a14acc6f1ac None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.119918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.120532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.120834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.121387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/18129a6b85244d64a5bd0a61709b90f7/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.123172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] RBAC: Authorizing `identity:create_grant(project_id=2e509ee5f9c2491794d91598205ffe49, user_id=18129a6b85244d64a5bd0a61709b90f7, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.124788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.146926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 62/123] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:56 2022] PUT /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/18129a6b85244d64a5bd0a61709b90f7/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:57.148581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.193134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6a690-88c9-40f4-80f1-13decbf228b5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.225231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.246789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.247809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.248302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.248920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.249840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:57.250425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.252319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577696a-19ec-4f6e-95a7-725907c20a6f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.263424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 62/124] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.265815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c974-1ddb-4879-ba9e-bc382a52b9cd None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.266369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c974-1ddb-4879-ba9e-bc382a52b9cd None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.266826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9c974-1ddb-4879-ba9e-bc382a52b9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.285386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042cb0b-fcc6-4553-bd3b-a7925af06aec None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.287446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-04e9c974-1ddb-4879-ba9e-bc382a52b9cd None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:57.289024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-04e9c974-1ddb-4879-ba9e-bc382a52b9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:57.324195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.332599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.333243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.333525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.333805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.334555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:57.334864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.336298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.347796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 63/125] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.348919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.390892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 63/126] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:57.392102 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560693-3532-473e-b92d-bfb19f071faf None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.392371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560693-3532-473e-b92d-bfb19f071faf None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.392667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19560693-3532-473e-b92d-bfb19f071faf None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.393919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 64/127] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:57.394620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19560693-3532-473e-b92d-bfb19f071faf None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.470601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dca197-976b-42f1-8421-10f16014ab87 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.510397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d109e2-2cf5-4cf9-bfb8-fdc746c73027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.511488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d109e2-2cf5-4cf9-bfb8-fdc746c73027 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.511978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d109e2-2cf5-4cf9-bfb8-fdc746c73027 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.512439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d109e2-2cf5-4cf9-bfb8-fdc746c73027 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.513847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d109e2-2cf5-4cf9-bfb8-fdc746c73027 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.515851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d109e2-2cf5-4cf9-bfb8-fdc746c73027 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.518250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 64/128] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.519609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.520040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.520478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.526140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19560693-3532-473e-b92d-bfb19f071faf None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.538139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.541515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:57.542928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:57.565332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.566083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.566416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.566778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.568510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.570414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.573277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 65/129] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.573972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.609564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.622049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 65/130] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:57.622988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.705340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f8933-353f-41e6-8c85-ec1a9ef07440 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.725376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d5d20-1128-4629-9b1a-07535b8306ce None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.741969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.742796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.743240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.743514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.757281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:57.762839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:57.763720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:08:57.764510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:57.765086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.765086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.765587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 66/131] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:57.765672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.765672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.765795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.766669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.769498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.769498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 66/132] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.770133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.817140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.846581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:57.899146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15403da2-38d5-4ce1-a9a3-36fb2d44adf0 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.902306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c3e2e-7f0a-49fa-a6f1-063215e6d9b2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:57.936321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.937340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.937483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.937721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.938906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.940588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.946300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:57.947151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:57.947401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 67/133] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.947715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:57.948169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:57.948272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:57.949865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:57.951768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:57.954513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 67/134] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:57.960605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.067247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6afca-56b8-4345-a83a-aba01d15884b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.077732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.083609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc726d07-4194-48fb-9161-ee03a6376d52 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.112182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.113636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.114189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.114657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.115705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:58.116157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.116369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.118488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.126965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.127973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.128446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.128888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/18129a6b85244d64a5bd0a61709b90f7/roles/d4751935dff54d9f83198053a192832d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.129334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 68/135] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:58.130204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.131699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e509ee5f9c2491794d91598205ffe49, user_id=18129a6b85244d64a5bd0a61709b90f7, role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.133618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.155412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 68/136] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:57 2022] PUT /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/18129a6b85244d64a5bd0a61709b90f7/roles/d4751935dff54d9f83198053a192832d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:58.156504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.274761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a550c-c3d5-4976-92da-fe439c328426 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.314758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.315686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.316135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.316877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.317731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.319663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.357394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 69/137] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:08:58 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:08:58.358607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.411771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbeb5c-1ef5-4814-ae7f-90af268b84e0 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.444777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.464008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdbdfb-62c6-40a1-bffb-1418a1483c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.464763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdbdfb-62c6-40a1-bffb-1418a1483c74 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.465040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdbdfb-62c6-40a1-bffb-1418a1483c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.465326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdbdfb-62c6-40a1-bffb-1418a1483c74 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/881d465484874e7283e8dee880624ffb/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.467369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdbdfb-62c6-40a1-bffb-1418a1483c74 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e509ee5f9c2491794d91598205ffe49, user_id=881d465484874e7283e8dee880624ffb, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.468953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdbdfb-62c6-40a1-bffb-1418a1483c74 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.490675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 69/138] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:58 2022] PUT /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/881d465484874e7283e8dee880624ffb/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:58.491738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914c48-80b0-44cf-9091-40e944ee36b1 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.492029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914c48-80b0-44cf-9091-40e944ee36b1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.492304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d914c48-80b0-44cf-9091-40e944ee36b1 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.493662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 70/139] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:58.500638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.501070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.501471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.523752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:58.525255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:58.527183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b68813-d697-4814-96ed-01c6d9bf343d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.556664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.566009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.566671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.567286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.567577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.569020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.570831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.572675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 70/140] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:58.578609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.664439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 71/141] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:58.704467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8264c-2883-4ca8-96d9-045e42d34d7f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.724216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:58.741908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.750976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.751615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.751891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.752160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] PATH_INFO: `/v3/projects/8fbed2591da64310bc85a35017b191d9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.753330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=8fbed2591da64310bc85a35017b191d9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.754789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.760525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 71/142] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/projects/8fbed2591da64310bc85a35017b191d9 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:58.762658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:58.866197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0ee4-93b3-4ae1-9d40-9cff14d1f4e6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.899038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947bde5-a352-4d94-97e5-ed1d46eb7a99 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:58.930938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.931616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.931898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.932161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] PATH_INFO: `/v3/projects/8fbed2591da64310bc85a35017b191d9/users/18129a6b85244d64a5bd0a61709b90f7/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.937753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fbed2591da64310bc85a35017b191d9, user_id=18129a6b85244d64a5bd0a61709b90f7, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:58.939215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:58.960283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 72/143] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:58 2022] PUT /identity/v3/projects/8fbed2591da64310bc85a35017b191d9/users/18129a6b85244d64a5bd0a61709b90f7/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:08:58.962313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:58.962965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:58.963235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:58.963511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:58.976056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:08:58.981055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:08:58.981931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:08:58.982713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:08:58.986242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 72/144] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:08:58.988816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.040071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.110840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0325-dcef-4229-a530-b3fe359945c1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.153764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.154369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.154635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.154908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.155576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:08:59.155877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.157260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.167021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 73/145] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:08:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:59.172909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.193846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.295833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698b5f3-95c9-488e-b48e-74e11e20d2b9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.337940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.339052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.339570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.340037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] PATH_INFO: `/v3/users/8c71f1f6cc244b3f9469f78f36e264de` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.341586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] RBAC: Authorizing `identity:get_user(user_id=8c71f1f6cc244b3f9469f78f36e264de)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.343339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.346031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 73/146] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:08:59 2022] GET /identity/v3/users/8c71f1f6cc244b3f9469f78f36e264de => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:08:59.351455 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.466083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70903d-5b2e-4a5c-a9f7-05560252f8ed None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.468038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.503845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca60ebba-6005-4e9f-808a-397fdbf94553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.504978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60ebba-6005-4e9f-808a-397fdbf94553 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.505448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60ebba-6005-4e9f-808a-397fdbf94553 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.505904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60ebba-6005-4e9f-808a-397fdbf94553 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.507410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60ebba-6005-4e9f-808a-397fdbf94553 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.509136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca60ebba-6005-4e9f-808a-397fdbf94553 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.511035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 74/147] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:08:59 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:08:59.517477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.629471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:08:59.646490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53579a6a-dc9d-44ea-a44e-4bfe31ff95cc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.651217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56f89-194a-4a37-9e8a-a6952f8052c7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.652086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56f89-194a-4a37-9e8a-a6952f8052c7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.652654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c56f89-194a-4a37-9e8a-a6952f8052c7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.654316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 75/148] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:08:59.659283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.659813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.660273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.692555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.692555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.692555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.692555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/8c71f1f6cc244b3f9469f78f36e264de/roles/f573691e90cc403d9084314ae7ee8b01` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:08:59.694310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:08:59.694489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] RBAC: Authorizing `identity:create_grant(project_id=2e509ee5f9c2491794d91598205ffe49, user_id=8c71f1f6cc244b3f9469f78f36e264de, role_id=f573691e90cc403d9084314ae7ee8b01)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:08:59.695953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:08:59.696172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:08:59.721703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 74/149] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:08:59 2022] PUT /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49/users/8c71f1f6cc244b3f9469f78f36e264de/roles/f573691e90cc403d9084314ae7ee8b01 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:08:59.792395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 76/150] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:08:59.827748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:08:59.951447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527281e-c8f0-4dbf-9ec8-59aed87ad3ac None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:08:59.992131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:08:59.993646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:08:59.993646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:08:59.993646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:00.005673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:00.010767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:00.011673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:00.012527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 75/151] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:08:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:00.019989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:00.159271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:00.163698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ccef-634a-4fd8-8880-1a27ee274e41 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:00.210907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:00.211978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:00.212491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:00.212968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:00.213838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:00.214337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:00.216012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:00.228999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 77/152] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:00.234244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:00.246937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:00.369856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a6f9-5df7-4446-818d-345c00f761c8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:00.415523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:00.416175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:00.416475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:00.416743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:00.420984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:00.422449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:00.424494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 76/153] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:00 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:00.430273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:00.573357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852a24d-d600-4bb9-b33b-379606b418c0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:00.619194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:00.620233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:00.620735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:00.621223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:00.661233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:00.710329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:00.712230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:00.833163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 78/154] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:00.838941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:00.976251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.009421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718bad5-1bd7-4c6f-b7d3-b09b73a891d6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.056043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a865e0-20cc-4ca5-bc16-63d4309e0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:01.056740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a865e0-20cc-4ca5-bc16-63d4309e0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.057016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a865e0-20cc-4ca5-bc16-63d4309e0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.057284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a865e0-20cc-4ca5-bc16-63d4309e0ff6 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.058445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a865e0-20cc-4ca5-bc16-63d4309e0ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:01.059910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a865e0-20cc-4ca5-bc16-63d4309e0ff6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:01.061813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 77/155] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:00 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:01.067906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:01.164750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:01.220134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7e31e-0edd-4c8b-972f-234f8c8e8a46 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:01.259975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:01.260632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:01.260914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:01.261186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:01.261926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=18129a6b85244d64a5bd0a61709b90f7) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:01.262237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:01.263687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296c94a-e53a-426a-8b4a-c8b07788d19d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:01.271151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 79/156] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:01 2022] GET /identity/v3/role_assignments?user.id=18129a6b85244d64a5bd0a61709b90f7&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.066404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd1cf-42fa-4bc7-9a2f-6cd153babff8 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.066933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd1cf-42fa-4bc7-9a2f-6cd153babff8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.066933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfd1cf-42fa-4bc7-9a2f-6cd153babff8 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.068502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 78/157] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:02.074139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.075105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.075576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.096065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:02.097590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:02.118787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22b2b-d91e-480b-9b6a-423d18320a74 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.119390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22b2b-d91e-480b-9b6a-423d18320a74 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.119865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa22b2b-d91e-480b-9b6a-423d18320a74 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.121421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 79/158] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:02.130306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.130877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.131426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.158445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:02.164852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:02.210492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 80/159] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:02.266230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 80/160] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:02.276888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.307195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.379972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.469906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.486278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53896ae6-a71c-42b3-83ee-e5c5f7a28066 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.535590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.536854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.537310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.537881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.548844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:02.554466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:02.555388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:02.556180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:02.558661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 81/161] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:02.564559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.574338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c61a8-73e8-451c-9dde-e80776aa5741 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.691613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf4ba5-903c-4e90-989d-e56cf39e5027 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.696402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.696402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.696402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.696402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.717417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:02.722319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:02.723391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:02.724242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:02.725003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.730147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 81/162] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:02.731270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.751798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.752752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.753249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.753723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.754582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:02.755115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.756896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.772519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 82/163] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.778335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.840712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3ec9-88e0-4e4e-93bf-89afdf859859 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:02.872762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:02.878297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:02.879246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.879939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.892633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.893646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:02.894093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:02.895698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ac094-bf6e-4390-bf55-529a9b73eedf None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:02.908704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 82/164] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:02.910653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb34e8-3ce5-4275-8311-da0ae1bf91b8 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:02.911229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb34e8-3ce5-4275-8311-da0ae1bf91b8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:02.911632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb34e8-3ce5-4275-8311-da0ae1bf91b8 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:02.913244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 83/165] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:02.915266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb34e8-3ce5-4275-8311-da0ae1bf91b8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:02.977680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e192cf-3966-4afd-9ad2-7e05583faca4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.024858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf2ea9-dca2-4c1a-af97-f506c5bbd8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.025885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2ea9-dca2-4c1a-af97-f506c5bbd8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.026391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2ea9-dca2-4c1a-af97-f506c5bbd8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.026855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf2ea9-dca2-4c1a-af97-f506c5bbd8d6 None admin] PATH_INFO: `/v3/users/881d465484874e7283e8dee880624ffb` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.028209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf2ea9-dca2-4c1a-af97-f506c5bbd8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=881d465484874e7283e8dee880624ffb)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.029903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf2ea9-dca2-4c1a-af97-f506c5bbd8d6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.031731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 83/166] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/users/881d465484874e7283e8dee880624ffb => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:03.033118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.033629 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.034103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.057250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:03.058814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:03.076371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb34e8-3ce5-4275-8311-da0ae1bf91b8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.104317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.130274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 84/167] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:03.131640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.134177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.134982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.135256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.135516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.141287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.142840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.144728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 84/168] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:02 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:03.151271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.238130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdb95c-5496-4686-af65-76130c242ec7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.272823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.275223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.275854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.276132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.276430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.328866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a757e-b1fd-4dcb-887d-86ed72bc13b7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.378828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.410026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa730c-1cdc-402d-a196-f0302fdeabc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.410711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa730c-1cdc-402d-a196-f0302fdeabc8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.410994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa730c-1cdc-402d-a196-f0302fdeabc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.411256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa730c-1cdc-402d-a196-f0302fdeabc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.412151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.414008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.542650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa730c-1cdc-402d-a196-f0302fdeabc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.544472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa730c-1cdc-402d-a196-f0302fdeabc8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.571314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 85/169] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:03.572548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.604533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.653270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 85/170] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:03.655572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab56f-92b1-4be1-85a2-1991f7aaffea None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.656000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab56f-92b1-4be1-85a2-1991f7aaffea None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.656446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ab56f-92b1-4be1-85a2-1991f7aaffea None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.658520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 86/171] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:03.659360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ab56f-92b1-4be1-85a2-1991f7aaffea None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.691549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.721244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416face-fee9-488f-bdbf-53efb3d398e4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.762891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c133a-85e5-451d-bf0b-a1cfeb26ba7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.763533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c133a-85e5-451d-bf0b-a1cfeb26ba7c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.763803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c133a-85e5-451d-bf0b-a1cfeb26ba7c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.764066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c133a-85e5-451d-bf0b-a1cfeb26ba7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.774928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c133a-85e5-451d-bf0b-a1cfeb26ba7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6a9c133a-85e5-451d-bf0b-a1cfeb26ba7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:03.779581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:03.780750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:03.781645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 86/172] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:03.782297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261073-be67-47b3-9974-c4085ea24c3d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.782297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261073-be67-47b3-9974-c4085ea24c3d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.782957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261073-be67-47b3-9974-c4085ea24c3d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.792223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 87/173] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:03.792223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261073-be67-47b3-9974-c4085ea24c3d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.796436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ab56f-92b1-4be1-85a2-1991f7aaffea None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.837500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b173e63-2b5e-40ea-8ba8-1925fe0befc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.838500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173e63-2b5e-40ea-8ba8-1925fe0befc9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.838746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173e63-2b5e-40ea-8ba8-1925fe0befc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.839283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b173e63-2b5e-40ea-8ba8-1925fe0befc9 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.840563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173e63-2b5e-40ea-8ba8-1925fe0befc9 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.842270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b173e63-2b5e-40ea-8ba8-1925fe0befc9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.849057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 87/174] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.849057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c5637-0638-4f20-97c7-ac65a9ff1877 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.849057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c5637-0638-4f20-97c7-ac65a9ff1877 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.849057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c5637-0638-4f20-97c7-ac65a9ff1877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.867144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9a8c5637-0638-4f20-97c7-ac65a9ff1877 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:03.868336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9a8c5637-0638-4f20-97c7-ac65a9ff1877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:03.896019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.902120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261073-be67-47b3-9974-c4085ea24c3d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:03.935919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eddb4d-e17d-45bc-812e-d303e7a39351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:03.936585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddb4d-e17d-45bc-812e-d303e7a39351 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.936866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddb4d-e17d-45bc-812e-d303e7a39351 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.937139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eddb4d-e17d-45bc-812e-d303e7a39351 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.938228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eddb4d-e17d-45bc-812e-d303e7a39351 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:03.938856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 88/175] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:03.940105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd19a1-ff75-4875-85b5-1ae3231cb388 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.940404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd19a1-ff75-4875-85b5-1ae3231cb388 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.940677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd19a1-ff75-4875-85b5-1ae3231cb388 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.941377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eddb4d-e17d-45bc-812e-d303e7a39351 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:03.946496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 89/176] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:03.946496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd19a1-ff75-4875-85b5-1ae3231cb388 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:03.946712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 88/177] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:03.946712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:03.946712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:03.946712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:03.956932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:03.968551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:03.969732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:04.038005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 89/178] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:04.047594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.047702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd19a1-ff75-4875-85b5-1ae3231cb388 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.079803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.080504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.080704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.080978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.081636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.081932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.083326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148c27b-85ea-4963-95af-86d12967decf None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.091603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 90/179] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.092790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595260f2-822f-4976-85a9-c2060d317431 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.093070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595260f2-822f-4976-85a9-c2060d317431 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.093337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595260f2-822f-4976-85a9-c2060d317431 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.094678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 91/180] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:04.097485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.097769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.098054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.115917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:04.117138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:04.134994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.148125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423d8df-6c99-4ca3-a870-b221e5dcba23 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.181517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.182122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.182401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.182674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.183394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=881d465484874e7283e8dee880624ffb) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.183701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.184815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 92/181] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:04.185172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.187014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.189253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.196156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 90/182] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/role_assignments?user.id=881d465484874e7283e8dee880624ffb&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.197444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.301786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcea7c-d203-4cf9-b4b2-93ef4c8955fa None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.311960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ab6a6-91f0-40f8-b7d4-607146d5ba16 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.338105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.338722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.338992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.339253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.339983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] RBAC: Adding query filter params (role.id=d4751935dff54d9f83198053a192832d, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=18129a6b85244d64a5bd0a61709b90f7) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.340281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.341751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.349118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 93/183] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/role_assignments?user.id=18129a6b85244d64a5bd0a61709b90f7&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=d4751935dff54d9f83198053a192832d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.349118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.355600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.356268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.356580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.356853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.372178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:04.377956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:04.378922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:04.379719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:04.382049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.382524 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 91/184] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:04.383660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.471311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.511051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e51af-5dd6-467e-86dc-296b21880264 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.524028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a20a-ff6b-4c1f-b795-3ced38a1e2ba None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.550906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.551543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.551870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.552082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.565063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:04.565403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d552b7-48bb-4b1f-aa0d-3c1ae1e5a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.566074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d552b7-48bb-4b1f-aa0d-3c1ae1e5a532 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.566359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d552b7-48bb-4b1f-aa0d-3c1ae1e5a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.566630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d552b7-48bb-4b1f-aa0d-3c1ae1e5a532 None admin] PATH_INFO: `/v3/users/18129a6b85244d64a5bd0a61709b90f7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.567833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d552b7-48bb-4b1f-aa0d-3c1ae1e5a532 None admin] RBAC: Authorizing `identity:get_user(user_id=18129a6b85244d64a5bd0a61709b90f7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.569396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d552b7-48bb-4b1f-aa0d-3c1ae1e5a532 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:04.570028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:04.570871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:04.571679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:04.572271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 92/185] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/users/18129a6b85244d64a5bd0a61709b90f7 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.572337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 94/186] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:04.572337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.578895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.579594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.579594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.599688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:04.601010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:04.652571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.665762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 93/187] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:04.666842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.676063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc53d0-895f-4bb2-9f69-0de668bd75dc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.711539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.712173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.712471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.712733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.722498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:04.722749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:04.727581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:04.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 95/188] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:04.729481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.766428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf26df-d935-4776-911c-5768abaa1f0f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.804701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.805260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.805535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.805801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.806471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.806769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.808142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.820100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 94/189] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.820732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:04.843423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c77344-f6c9-4980-9338-ac5dc8d17f16 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.886560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.887185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.887456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.887722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.892755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.933287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3565926-bccb-4f8b-a8a9-55d25eda9c0c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:04.952214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:04.963140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.965043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.971121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:04.971730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:04.972003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:04.972265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:04.972969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:04.973265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:04.974611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:04.982539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 95/190] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:04.987294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.065861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 96/191] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:05.066889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.096919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d12c26-3b38-49c9-84aa-70036461bf7f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.103648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.133225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.133852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.134123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.134387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.135462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.136920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.138491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 96/192] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.139238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.171071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e5c41-6525-4ca0-bb85-2f3e736d14ce None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.192559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.208106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.208743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.209014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.209889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.210553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:05.210852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.212266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.224761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 97/193] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.224761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.246549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b75276-ffd1-4dfe-899e-a12806536b99 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.280392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.281352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.281775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.282108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] PATH_INFO: `/v3/users/14d9b0829c20437898e7b6df13d7454b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.296946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] RBAC: Authorizing `identity:get_user(user_id=14d9b0829c20437898e7b6df13d7454b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.298408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.300026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 97/194] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/users/14d9b0829c20437898e7b6df13d7454b => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.300811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.321656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.325309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47566-12de-4a76-86d2-ca8fa6af86f2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.359211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.359843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.360117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.360408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] PATH_INFO: `/v3/users/14d9b0829c20437898e7b6df13d7454b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.361517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] RBAC: Authorizing `identity:get_user(user_id=14d9b0829c20437898e7b6df13d7454b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.362958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.364559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 98/195] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/users/14d9b0829c20437898e7b6df13d7454b => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.365292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.398184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4e6f-7258-44b6-ae0d-9b34483216a9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.406367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.434018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809806-6506-48e6-8de2-12062945481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.434670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809806-6506-48e6-8de2-12062945481b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.434966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809806-6506-48e6-8de2-12062945481b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.435231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37809806-6506-48e6-8de2-12062945481b None admin] PATH_INFO: `/v3/projects/8fbed2591da64310bc85a35017b191d9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.436311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37809806-6506-48e6-8de2-12062945481b None admin] RBAC: Authorizing `identity:get_project(project_id=8fbed2591da64310bc85a35017b191d9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.438110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37809806-6506-48e6-8de2-12062945481b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.439741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 98/196] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/projects/8fbed2591da64310bc85a35017b191d9 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.440515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809806-6506-48e6-8de2-12062945481b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.469019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcd405-70a1-41ea-aad2-ce1de661ede2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.502285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.502895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.503170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.503479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.504106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.505579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.527695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 99/197] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:05 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:05.528909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.552721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37809806-6506-48e6-8de2-12062945481b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.556979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.593116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.593686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.593976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.594212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] PATH_INFO: `/v3/users/8c71f1f6cc244b3f9469f78f36e264de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.595397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] RBAC: Authorizing `identity:get_user(user_id=8c71f1f6cc244b3f9469f78f36e264de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.596891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.603289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 99/198] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/users/8c71f1f6cc244b3f9469f78f36e264de => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:05.603289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.649535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d2fe-788a-41f7-b4c0-660eae929da3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.650527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.694264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.695154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.695430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.713283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e51b0-4780-4146-9d71-5f4ea55aa834 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:05.755718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:05.756703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:05.757664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:05.757664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:05.784071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.786044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.813616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.846909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:05.848316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:05.906026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:05.917174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 100/199] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:05.918583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:05.967595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 100/200] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:05.972604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.052814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62599f3e-aedd-4324-9133-b7fa2ceecf68 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.077046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da476cce-0606-48b1-89f0-9e29809c49ca None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.083812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.098673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.099664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.100058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.100635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.101381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=8fbed2591da64310bc85a35017b191d9, user.id=18129a6b85244d64a5bd0a61709b90f7) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:06.101686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.103891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.112017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 101/201] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/role_assignments?user.id=18129a6b85244d64a5bd0a61709b90f7&scope.project.id=8fbed2591da64310bc85a35017b191d9&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.112864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.121252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.121886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.122157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.122419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.164809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.195189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.196734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.274438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19222e36-4c81-40b5-b55c-60fddd834b98 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.323200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 101/202] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:06.324191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.363505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.364067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.364343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.364646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.365903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.367546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.375977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.376635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 102/203] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.377589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.446726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.447138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba655f-b4a2-4c0b-82a6-0abc34d425c3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.499179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.499818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.500089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.500353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.501590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.503038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.505077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 102/204] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.510560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.510704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644050a2-9ae5-4b94-9b36-d2e2ee653756 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.556562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.557587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.558176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.558656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.560141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.564707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.566809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.567886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.627625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9a82-b1b2-4eb7-b3f8-9780c86eec28 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.641446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.670154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.671204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.671700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.672268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.673262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=14d9b0829c20437898e7b6df13d7454b) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:06.673845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.675569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.677422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbe86b-2b3c-459c-8c1c-164ccf5c1700 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.684042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 103/206] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/role_assignments?user.id=14d9b0829c20437898e7b6df13d7454b&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.693939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:06.701931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:06.741748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.742371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.742642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.742907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.743639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] RBAC: Adding query filter params (role.id=d4751935dff54d9f83198053a192832d, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=14d9b0829c20437898e7b6df13d7454b) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:06.743940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.745409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a51cf-b314-4e79-9aef-dba79df96533 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.760222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 104/207] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/role_assignments?user.id=14d9b0829c20437898e7b6df13d7454b&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=d4751935dff54d9f83198053a192832d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:06.817061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ff7ed-07ff-40a5-bb6b-32e4aa474b26 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:06.859152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:06.860155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:06.860669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:06.861164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:06.862125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] RBAC: Adding query filter params (role.id=f573691e90cc403d9084314ae7ee8b01, scope.project.id=2e509ee5f9c2491794d91598205ffe49, user.id=8c71f1f6cc244b3f9469f78f36e264de) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:06.862638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:06.864313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc668b9a-129e-4443-9b04-40ef7f170b04 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:06.871994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 104/208] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:06 2022] GET /identity/v3/role_assignments?user.id=8c71f1f6cc244b3f9469f78f36e264de&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=f573691e90cc403d9084314ae7ee8b01 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:07.771035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6bb12-3ad6-4e90-8cd4-a76cc2b10f3d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.771592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6bb12-3ad6-4e90-8cd4-a76cc2b10f3d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.771592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6bb12-3ad6-4e90-8cd4-a76cc2b10f3d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.773395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 105/209] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:07.778619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a108e-8cba-4463-aa97-7cdb8f838852 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.779409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a108e-8cba-4463-aa97-7cdb8f838852 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.779876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a108e-8cba-4463-aa97-7cdb8f838852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.798697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a76a108e-8cba-4463-aa97-7cdb8f838852 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:07.800198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a76a108e-8cba-4463-aa97-7cdb8f838852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:07.831383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:07.872001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 105/210] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:07.894966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6bb12-3ad6-4e90-8cd4-a76cc2b10f3d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:07.902440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235203-fec1-4db6-b187-e3c090452d4f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.902726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235203-fec1-4db6-b187-e3c090452d4f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.903003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d235203-fec1-4db6-b187-e3c090452d4f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.904367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 106/211] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:07.909579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:07.909856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:07.910130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:07.931700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:07.932944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:08.014844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6bb12-3ad6-4e90-8cd4-a76cc2b10f3d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.025106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 107/212] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:08.048507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.056134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.056804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.057075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.057339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.067894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:08.073230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:08.074134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:08.074923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 106/213] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:08.082045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.131420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.150607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.154728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd07a0-9a91-418f-adbf-a409e2f16545 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.191615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66dc0-9506-417c-8cfc-29b1f884bb9f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.196267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.197174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.197656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.198123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.199837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.201952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.204307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 108/214] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:08.209993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.230684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.231629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.232144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.232651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.233569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:08.234127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.235765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.245449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 107/215] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:08.250818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.346431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d96d46-1dd2-4dc9-aca6-38419072307b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.360469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a437a-bfec-468f-9bcc-9a1995efe8b2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.371119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.394810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.395423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.395697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.395962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.396712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.398229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.404045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.404976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.405550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.406008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] PATH_INFO: `/v3/users/740d953846794b42a3c2be4e45b65cdb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.421962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] RBAC: Authorizing `identity:get_user(user_id=740d953846794b42a3c2be4e45b65cdb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.432407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 109/216] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:08 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:09:08.432608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.432608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 108/217] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/users/740d953846794b42a3c2be4e45b65cdb => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:08.433021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.465015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.554283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3cc56-e9c4-4f02-817e-32cfc0feb552 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.594793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.595413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.595689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.595958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.669512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.671193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.695564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:08.777356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 110/218] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:08.785564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.898876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac234d-72cd-4983-a8ea-7d3e103867e7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:08.935785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a46d98-2b9d-41a7-9539-e8d997677eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:08.936424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a46d98-2b9d-41a7-9539-e8d997677eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.936706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a46d98-2b9d-41a7-9539-e8d997677eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.936980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a46d98-2b9d-41a7-9539-e8d997677eb5 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.938103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a46d98-2b9d-41a7-9539-e8d997677eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:08.939564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a46d98-2b9d-41a7-9539-e8d997677eb5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:08.941538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 109/219] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:08.949544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:08.964640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51795365-0ae8-4700-b15c-c05f0cad04b0 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.964939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51795365-0ae8-4700-b15c-c05f0cad04b0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.965170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51795365-0ae8-4700-b15c-c05f0cad04b0 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.966993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 110/220] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:08.968033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2abca0-4c21-4028-a67c-1d27d36d34c1 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.968311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2abca0-4c21-4028-a67c-1d27d36d34c1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.968683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2abca0-4c21-4028-a67c-1d27d36d34c1 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.969870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 111/221] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:08.972197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64301fa-128c-46cb-80e4-cc2a918ab6f7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:08.972513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64301fa-128c-46cb-80e4-cc2a918ab6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:08.972780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64301fa-128c-46cb-80e4-cc2a918ab6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:08.991883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e64301fa-128c-46cb-80e4-cc2a918ab6f7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:08.993536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e64301fa-128c-46cb-80e4-cc2a918ab6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:09.023650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.063992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637a929-fd03-4aff-a072-347d554b6e3d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.070375 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 112/222] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:09.071876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.072353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.073418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.090787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.098929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:09.101035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:09.103439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.104153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.104536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.104916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.105958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=740d953846794b42a3c2be4e45b65cdb) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:09.106066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.107729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.115072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 111/223] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:08 2022] GET /identity/v3/role_assignments?user.id=740d953846794b42a3c2be4e45b65cdb&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:09.115841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.244447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 113/224] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:09.249234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396abf4-a714-4cfe-b1a3-959893638bcf None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.281897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.285935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.286586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.286859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.287151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.299271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:09.304738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:09.305645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:09.306454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 112/225] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:09.311836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.361883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.399469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.411689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2f39b-8c1a-4768-89bf-14d63c723d0d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.418467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82968560-6c62-4d5c-a24d-4707a94f31af None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.452162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.452801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.453072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.453340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.453998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:09.454298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.455688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.464349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 113/226] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:09.469835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.490917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.491619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.491936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.492208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.517401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:09.522202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:09.523065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:09.523884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:09.528502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 114/227] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:09.531055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.569725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cd912-2cc3-4fe3-a052-f8b61e21a928 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.579306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.604521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.605171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.605431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.605696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] PATH_INFO: `/v3/users/14d9b0829c20437898e7b6df13d7454b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.606819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] RBAC: Authorizing `identity:get_user(user_id=14d9b0829c20437898e7b6df13d7454b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.608260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.614374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 114/228] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/users/14d9b0829c20437898e7b6df13d7454b => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:09.624724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.736265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b39f71-c6a4-4831-b0d9-e2947d389567 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.778314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b3f8a-1be5-493b-8e46-bd7f44b9daac None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:09.797256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.797979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.798251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.798513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.799172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:09.799464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.800893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.814439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 115/229] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:09.815675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.838078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.850381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:09.851021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:09.851292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:09.851560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:09.853354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:09.854983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:09.857814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 115/230] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:09.865157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:09.951188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:09.971657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf2005-b0b4-4c81-9c3e-0c97fdbee313 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.006887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.007521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.007791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.008052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] PATH_INFO: `/v3/users/14d9b0829c20437898e7b6df13d7454b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.009196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] RBAC: Authorizing `identity:get_user(user_id=14d9b0829c20437898e7b6df13d7454b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.010639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.016513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 116/231] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:09 2022] GET /identity/v3/users/14d9b0829c20437898e7b6df13d7454b => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:10.018709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.052942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81a5cb-8842-4d3b-969d-6f617a5531d8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.087830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.088534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.089072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.089345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/14d9b0829c20437898e7b6df13d7454b/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.092269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] RBAC: Authorizing `identity:create_grant(project_id=01376d53fad54cb09d721bfe77b948e8, user_id=14d9b0829c20437898e7b6df13d7454b, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.093752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.106621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.111736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 116/232] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:09 2022] PUT /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/14d9b0829c20437898e7b6df13d7454b/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:09:10.130062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2eb5f-a4d0-4d16-a9a4-9a45b2fba09d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.170477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a17ba8e-b48a-4249-a685-23fd8a1a5c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.171121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17ba8e-b48a-4249-a685-23fd8a1a5c85 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.171431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17ba8e-b48a-4249-a685-23fd8a1a5c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.171701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a17ba8e-b48a-4249-a685-23fd8a1a5c85 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.172849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17ba8e-b48a-4249-a685-23fd8a1a5c85 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.174352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a17ba8e-b48a-4249-a685-23fd8a1a5c85 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.176300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 117/233] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:10 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:10.182502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:10.292540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3c002-4d4b-4b1c-8870-5bd85b97791c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:10.302244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:10.328837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8933a9b3-7914-47ba-9467-132148e582f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:10.329469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a9b3-7914-47ba-9467-132148e582f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.329746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a9b3-7914-47ba-9467-132148e582f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.330011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8933a9b3-7914-47ba-9467-132148e582f9 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/14d9b0829c20437898e7b6df13d7454b/roles/d4751935dff54d9f83198053a192832d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.332632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933a9b3-7914-47ba-9467-132148e582f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=01376d53fad54cb09d721bfe77b948e8, user_id=14d9b0829c20437898e7b6df13d7454b, role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:10.334130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8933a9b3-7914-47ba-9467-132148e582f9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:10.353650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 117/234] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:10 2022] PUT /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/14d9b0829c20437898e7b6df13d7454b/roles/d4751935dff54d9f83198053a192832d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:10.994368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de922b7a-32f3-450d-b9af-4d0b8e200d69 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:10.994888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de922b7a-32f3-450d-b9af-4d0b8e200d69 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:10.994888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de922b7a-32f3-450d-b9af-4d0b8e200d69 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:10.996506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 118/235] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:11.001535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63886f4-f4b0-474a-b751-3db92bd4553c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.001953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63886f4-f4b0-474a-b751-3db92bd4553c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.002121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63886f4-f4b0-474a-b751-3db92bd4553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.029001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c63886f4-f4b0-474a-b751-3db92bd4553c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:11.030222 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c63886f4-f4b0-474a-b751-3db92bd4553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:11.111014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 118/236] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:11.145462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de922b7a-32f3-450d-b9af-4d0b8e200d69 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.233104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c89b-7b96-43b6-b7fd-a56d2ebe3c7d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.233432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c89b-7b96-43b6-b7fd-a56d2ebe3c7d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.233695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76c89b-7b96-43b6-b7fd-a56d2ebe3c7d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.235100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 119/237] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:11.240277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.240659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.240929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.268590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de922b7a-32f3-450d-b9af-4d0b8e200d69 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.279971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:11.281205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:11.331721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.332361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.332657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.332921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.351186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:11.356351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:11.357285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:11.358080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:11.359150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 119/238] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:11.365487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.390670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.401501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 120/239] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:11.440403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.465342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.542326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a10ca-4770-4017-875e-51a31b174553 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.563726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221336f1-a1e5-4164-b785-cea1b84c45b1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.612918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.613537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.613813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.614083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.614746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:11.615045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.616715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.631301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.631932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.632202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.632493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.633573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 120/240] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:11.634177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.635631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.641803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 121/241] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:11.643336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.649199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.790250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.822282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760203f-e1e6-4df6-bead-f4788c49234c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.824841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:11.836733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05e6b4-78af-4ea6-98c1-f337cd52a0f0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:11.861132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec9bc11-b38c-4cfb-af3d-e617d95e1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.862139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9bc11-b38c-4cfb-af3d-e617d95e1723 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.862562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9bc11-b38c-4cfb-af3d-e617d95e1723 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.862981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9bc11-b38c-4cfb-af3d-e617d95e1723 None admin] PATH_INFO: `/v3/users/546d9faa97f14dedb4ff47a36d86637e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.878316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9bc11-b38c-4cfb-af3d-e617d95e1723 None admin] RBAC: Authorizing `identity:get_user(user_id=546d9faa97f14dedb4ff47a36d86637e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.878586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b51583-961c-47e7-82fe-5bf157b1d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:11.879287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51583-961c-47e7-82fe-5bf157b1d909 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.879650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51583-961c-47e7-82fe-5bf157b1d909 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.880007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b51583-961c-47e7-82fe-5bf157b1d909 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.885549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b51583-961c-47e7-82fe-5bf157b1d909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:11.885549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b51583-961c-47e7-82fe-5bf157b1d909 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.888864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec9bc11-b38c-4cfb-af3d-e617d95e1723 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:11.891555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 121/242] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/users/546d9faa97f14dedb4ff47a36d86637e => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:11.892952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ffdd-881a-4ebc-ad60-138792d9bc12 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.893373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ffdd-881a-4ebc-ad60-138792d9bc12 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.893782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ffdd-881a-4ebc-ad60-138792d9bc12 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.895268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 122/243] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:11.900751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ffdd-881a-4ebc-ad60-138792d9bc12 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:11.913581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 122/244] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:11 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:11.920625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:11.920625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:11.920625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:11.961567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:11.963707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:12.116489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 123/245] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:12.123488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ffdd-881a-4ebc-ad60-138792d9bc12 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.138160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.160926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.168913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.169959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.170289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.170619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.233761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.245834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.247420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.263027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd8b40-80ce-43c2-90b1-19dec02b9d1d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.313179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.313386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.313658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.313813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.332284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:12.337519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:12.338511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:12.339302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:12.343607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 124/246] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:12.345001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.364220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 123/247] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:12.375327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.436865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.490472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba19036-84c5-4f18-ac43-88818c45d8c8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.517179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557f437-40f9-42fa-8d92-a8fde0848c92 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.531017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.532002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.532814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.533250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.534319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:12.534769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.536732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe34abd0-c608-43da-8472-43295e64c918 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.545598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.552471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 125/248] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:12.554920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42934228-ca54-4ed8-8643-8ad193288db0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.555203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42934228-ca54-4ed8-8643-8ad193288db0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.555473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42934228-ca54-4ed8-8643-8ad193288db0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.556835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 126/249] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:12.557520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42934228-ca54-4ed8-8643-8ad193288db0 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.559452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e581b-ee04-4b6b-b056-76dad2af6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.560316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e581b-ee04-4b6b-b056-76dad2af6105 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.560906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e581b-ee04-4b6b-b056-76dad2af6105 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.561326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e581b-ee04-4b6b-b056-76dad2af6105 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.562588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e581b-ee04-4b6b-b056-76dad2af6105 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.564172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e581b-ee04-4b6b-b056-76dad2af6105 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.566144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 124/250] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:12.567553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.567966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.568422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.586621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:12.588032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:12.657004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 125/251] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:12.658239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.679111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42934228-ca54-4ed8-8643-8ad193288db0 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.700908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:12.735220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.736302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.737887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.738350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] PATH_INFO: `/v3/users/740d953846794b42a3c2be4e45b65cdb` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.742568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] RBAC: Authorizing `identity:get_user(user_id=740d953846794b42a3c2be4e45b65cdb)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.745469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.754836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 127/252] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/users/740d953846794b42a3c2be4e45b65cdb => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:12.756095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.836584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330d8ed-f33e-4e39-a32a-7f00ab764d06 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:12.878696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:12.879308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:12.879574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:12.879835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:12.884702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] RBAC: Adding query filter params (role.id=f573691e90cc403d9084314ae7ee8b01, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=546d9faa97f14dedb4ff47a36d86637e) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:12.884702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:12.884702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:12.894610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 126/253] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/role_assignments?user.id=546d9faa97f14dedb4ff47a36d86637e&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=f573691e90cc403d9084314ae7ee8b01 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:12.897675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:12.899086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.003120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074f69-6523-4b7e-b2cf-edc0a0ec37b5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.053897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.066162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07263923-4909-446f-8df3-5f15a7119d64 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.069118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afbd8e-7ace-42c1-85b2-f941c1841d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.069842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbd8e-7ace-42c1-85b2-f941c1841d6d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.070186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbd8e-7ace-42c1-85b2-f941c1841d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.070545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afbd8e-7ace-42c1-85b2-f941c1841d6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.082584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afbd8e-7ace-42c1-85b2-f941c1841d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-92afbd8e-7ace-42c1-85b2-f941c1841d6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:13.088769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:13.089682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:13.090473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 128/254] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:13.091632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630b4d-86d7-4a11-8779-803707544ab2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.091632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630b4d-86d7-4a11-8779-803707544ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.091796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630b4d-86d7-4a11-8779-803707544ab2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.093230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 129/255] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:13.098227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630b4d-86d7-4a11-8779-803707544ab2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.113965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6e463-2cc2-4115-99fe-8e9c173f02d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.114998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e463-2cc2-4115-99fe-8e9c173f02d2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.115608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e463-2cc2-4115-99fe-8e9c173f02d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.116071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6e463-2cc2-4115-99fe-8e9c173f02d2 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.117782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6e463-2cc2-4115-99fe-8e9c173f02d2 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.119594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6e463-2cc2-4115-99fe-8e9c173f02d2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.121657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 127/256] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:12 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:13.122982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.123551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.132732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.164909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:13.166129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:13.238603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630b4d-86d7-4a11-8779-803707544ab2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.269366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.274900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.275528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.275796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.276113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.276956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:13.277331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.278771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.288719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 130/257] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:13.289670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.307719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 128/258] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:13.308971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.416472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad13c1-f224-47dc-b068-0f5df877687a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.451338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.452168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.452589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.452961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/740d953846794b42a3c2be4e45b65cdb/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.454983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] RBAC: Authorizing `identity:create_grant(project_id=01376d53fad54cb09d721bfe77b948e8, user_id=740d953846794b42a3c2be4e45b65cdb, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.456571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.479835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 131/259] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:13 2022] PUT /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/740d953846794b42a3c2be4e45b65cdb/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:13.480938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.482198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.503194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee056522-4df1-4407-954e-2f909b2c5ed1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.555033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.588241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.588935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.589237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.589515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] PATH_INFO: `/v3/users/14d9b0829c20437898e7b6df13d7454b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.591158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] RBAC: Authorizing `identity:get_user(user_id=14d9b0829c20437898e7b6df13d7454b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.592672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.595433 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 129/260] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/users/14d9b0829c20437898e7b6df13d7454b => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:13.600092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.621589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2f98b-5895-453d-b786-c26ed42440cb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.666813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.668332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.669056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.669750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.689517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:13.695698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:13.696784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:13.697625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:13.700292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 132/261] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:13.706608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:13.792977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929c4d-66b5-4bfa-8edc-b40facc743a8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.861568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.862113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.862380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.862639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.875159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1f3bf-0b40-45d0-946d-25da5eab61fe None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:13.899094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.924747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:13.958768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:13.959507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:13.959785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:13.960053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:13.963465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:13.963784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:13.965255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:13.983806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 133/262] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:13.994389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.007982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.009770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.140072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 130/263] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:14.145499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.202125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1201b9-115a-4601-a5c0-09a3fdcb4771 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:14.262823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:14.263507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:14.264165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:14.268489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:14.268845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] PATH_INFO: `/v3/users/14d9b0829c20437898e7b6df13d7454b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:14.270309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] RBAC: Authorizing `identity:get_user(user_id=14d9b0829c20437898e7b6df13d7454b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.271842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.273968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 134/264] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:13 2022] GET /identity/v3/users/14d9b0829c20437898e7b6df13d7454b => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:14.279431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.336623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8c85b-a29f-4e32-aa62-40e0edff9fe8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:14.380790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:14.409200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:14.409765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:14.410035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:14.410297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:14.411453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.413152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.414986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 131/265] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:14 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:14.420816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.451904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889b04-33bf-4aad-8cb3-83dfdda4d3ec None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:14.513288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:14.513936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:14.514213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:14.514490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:14.583849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.586042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.626959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:14.675587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512f66d-a5cd-4fb0-9d89-a88b1a22a918 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:14.685503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 135/266] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:14.691135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.728172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:14.744072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:14.744722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:14.744994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:14.745259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:14.746958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=14d9b0829c20437898e7b6df13d7454b) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:14.747263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.748729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.766165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 132/267] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:14 2022] GET /identity/v3/role_assignments?user.id=14d9b0829c20437898e7b6df13d7454b&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:14.826256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c5211-d763-4500-bf0a-df916b764040 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:14.863071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568210b8-76b3-47ee-be0e-f54fdc8a7147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:14.863717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568210b8-76b3-47ee-be0e-f54fdc8a7147 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:14.863995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568210b8-76b3-47ee-be0e-f54fdc8a7147 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:14.864263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568210b8-76b3-47ee-be0e-f54fdc8a7147 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:14.865462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568210b8-76b3-47ee-be0e-f54fdc8a7147 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:14.866919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568210b8-76b3-47ee-be0e-f54fdc8a7147 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:14.868922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 136/268] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:14 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:14.877564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:14.997112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54496-4792-4819-9a22-e656b2ae82ee None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.009647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53a320-3694-4190-a5b1-444cd385a215 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.009981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53a320-3694-4190-a5b1-444cd385a215 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.010295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53a320-3694-4190-a5b1-444cd385a215 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.011551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 137/269] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:15.025505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.025733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.025975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.061361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:15.063893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:15.065694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.066602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.067074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.067536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.067987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.069006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] RBAC: Adding query filter params (role.id=d4751935dff54d9f83198053a192832d, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=14d9b0829c20437898e7b6df13d7454b) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:15.069542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:15.071213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e87435-74b1-431e-b5d8-d847f8075e1f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:15.087476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 133/270] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:14 2022] GET /identity/v3/role_assignments?user.id=14d9b0829c20437898e7b6df13d7454b&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=d4751935dff54d9f83198053a192832d => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:15.141580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 138/271] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:15.174738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447462c-ff89-45d2-a8cc-e45eecb9dd80 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.175292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447462c-ff89-45d2-a8cc-e45eecb9dd80 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.175292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447462c-ff89-45d2-a8cc-e45eecb9dd80 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.176664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 134/272] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:15.182518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.183582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.183857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.184120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.217592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:15.218809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:15.305892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.312713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f1b62-635d-47ed-8f5a-3e1412684c30 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.327980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 135/273] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:15.353436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.362545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.363187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.363522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.363791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.365837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:15.367398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:15.369494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 139/274] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:15.375426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.384754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.493707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc2ad8-4f2a-4390-ad27-e5ea755bb3c1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.506828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935f4d1-a99c-4e8c-a83d-0218b0a4fd6c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.537442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed794d86-9b04-4442-9249-d25389af5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.538447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794d86-9b04-4442-9249-d25389af5103 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.538949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794d86-9b04-4442-9249-d25389af5103 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.539424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed794d86-9b04-4442-9249-d25389af5103 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.554688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdcba0-fe30-4076-a0f1-e83b633eb80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.555302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdcba0-fe30-4076-a0f1-e83b633eb80d None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.555577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdcba0-fe30-4076-a0f1-e83b633eb80d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.555846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdcba0-fe30-4076-a0f1-e83b633eb80d None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.556597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdcba0-fe30-4076-a0f1-e83b633eb80d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:15.557511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed794d86-9b04-4442-9249-d25389af5103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:15.558063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdcba0-fe30-4076-a0f1-e83b633eb80d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-ed794d86-9b04-4442-9249-d25389af5103 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:15.562870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:15.563769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:15.564741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:15.567379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 136/275] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:15.571698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c039-156a-4be5-93ca-cef5505aab15 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.572268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c039-156a-4be5-93ca-cef5505aab15 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.572843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79c039-156a-4be5-93ca-cef5505aab15 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.574442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 137/276] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:15.575435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c039-156a-4be5-93ca-cef5505aab15 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.584277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 140/277] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:15 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:15.585842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.586130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.586458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.606408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:15.607631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:15.644795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.681290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.694514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 141/278] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:15.718279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79c039-156a-4be5-93ca-cef5505aab15 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.721409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.762357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.763289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.763708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.763978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.765003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:15.765846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:15.767526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:15.777312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 138/279] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:15.784250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.841054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0442c-26e4-43a0-aa36-418fa0522d20 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.882634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.883280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.883559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.883820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.899799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:15.904880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:15.905757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:15.906569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:15.907176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c425b-fd76-4d14-80b0-2b62da4d68fc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:15.907269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 142/280] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:15.913063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:15.922021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.961805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:15.962459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:15.962730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:15.963146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] PATH_INFO: `/v3/users/0741506ebecb45088ed2afc828c46232` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:15.983150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] RBAC: Authorizing `identity:get_user(user_id=0741506ebecb45088ed2afc828c46232)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:15.984642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:15.985704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:15.987816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 139/281] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/users/0741506ebecb45088ed2afc828c46232 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:15.994158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:16.045938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68e04c-676f-404b-99bf-6ffa1181b910 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:16.093126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:16.094210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.095144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.096019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:16.098157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:16.099850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:16.118669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 143/282] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:16.124316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:16.132690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262b64f-4c3f-4b85-a2e3-2f851f5d9f03 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:16.171334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:16.172328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.173055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.174082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.174997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, user.id=0741506ebecb45088ed2afc828c46232, scope.system=all) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:16.176112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:16.178701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:16.189160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 140/283] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 9 12:09:15 2022] GET /identity/v3/role_assignments?user.id=0741506ebecb45088ed2afc828c46232&scope.system=all&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:16.288517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342601a0-8f94-427a-a831-457e7abe7047 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:16.308370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:16.342060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:16.343578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.344064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.344547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] PATH_INFO: `/v3/users/546d9faa97f14dedb4ff47a36d86637e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.347890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=546d9faa97f14dedb4ff47a36d86637e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:16.349730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:16.351706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 144/284] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:16 2022] GET /identity/v3/users/546d9faa97f14dedb4ff47a36d86637e => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:16.357597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:16.396586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:16.471965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e7b3d-8e2e-46bf-a13b-79e9d21c2eb1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:16.508472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccab2b7-2782-44ae-8925-1e446536f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:16.509110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab2b7-2782-44ae-8925-1e446536f580 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.509377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab2b7-2782-44ae-8925-1e446536f580 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.509639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccab2b7-2782-44ae-8925-1e446536f580 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.510804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccab2b7-2782-44ae-8925-1e446536f580 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:16.512300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccab2b7-2782-44ae-8925-1e446536f580 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:16.514257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 141/285] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:16 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:16.521898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:16.654929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f59f-bcc7-4333-96cf-97ffc144461a None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.655105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f59f-bcc7-4333-96cf-97ffc144461a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.655362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159f59f-bcc7-4333-96cf-97ffc144461a None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.657019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 142/286] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:16.665850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.666122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.666384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.687804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e77662-1efd-4497-b653-2625a669a7a1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:16.700969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:16.702209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:16.752648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:16.753320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:16.753592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:16.753861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/546d9faa97f14dedb4ff47a36d86637e/roles/f573691e90cc403d9084314ae7ee8b01` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:16.757899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] RBAC: Authorizing `identity:create_grant(project_id=01376d53fad54cb09d721bfe77b948e8, user_id=546d9faa97f14dedb4ff47a36d86637e, role_id=f573691e90cc403d9084314ae7ee8b01)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:16.759342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:16.782949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 145/287] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:16 2022] PUT /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8/users/546d9faa97f14dedb4ff47a36d86637e/roles/f573691e90cc403d9084314ae7ee8b01 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:16.832674 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 143/288] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:16.868132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:16.921382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:16.986219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a3ba-2303-4a17-845d-c2e6b7d2b301 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.022828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.023472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.023754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.024024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.037569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:17.045517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:17.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:17.047238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 146/289] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:17.057550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.087198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.178067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0482-9e90-4f6c-943f-8d81166fbae1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.223575 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.224199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.224504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.224871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.225615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:17.225920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.227305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.238727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 144/290] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:17.244802 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.380882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d00af7-77af-445a-951f-eda4cf3983b7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.383253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.434534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.435092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.435369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.435638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] PATH_INFO: `/v3/users/740d953846794b42a3c2be4e45b65cdb` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.436801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] RBAC: Authorizing `identity:get_user(user_id=740d953846794b42a3c2be4e45b65cdb)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.438243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.440144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 147/291] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/users/740d953846794b42a3c2be4e45b65cdb => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:17.445671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:17.590043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.601578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe0ee2-20d4-4cd8-9751-56c88efa2f17 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:17.646599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284a878-807a-4976-be66-601760b7af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:17.647573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284a878-807a-4976-be66-601760b7af01 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:17.648070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284a878-807a-4976-be66-601760b7af01 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:17.648560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284a878-807a-4976-be66-601760b7af01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:17.727963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284a878-807a-4976-be66-601760b7af01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:17.729791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284a878-807a-4976-be66-601760b7af01 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:17.850104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:17.861955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 145/292] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:17.867771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.012346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b1eeb-6cbd-4b0a-b93b-939f2e71a513 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.057960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36f885-b267-482c-80d1-80967fa45c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.058969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f885-b267-482c-80d1-80967fa45c79 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.059461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f885-b267-482c-80d1-80967fa45c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.059929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36f885-b267-482c-80d1-80967fa45c79 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.061304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f885-b267-482c-80d1-80967fa45c79 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.062943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36f885-b267-482c-80d1-80967fa45c79 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.064920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 148/293] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:17 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:18.071497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284a878-807a-4976-be66-601760b7af01 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.130481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5d78-eafd-479b-af99-a424331c686b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.131765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5d78-eafd-479b-af99-a424331c686b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.132234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad5d78-eafd-479b-af99-a424331c686b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.135726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 149/294] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:18.139437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.139717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.139986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.165409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:18.166615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:18.198292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.200724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284a878-807a-4976-be66-601760b7af01 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.236327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.237109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.237609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.237969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.238833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=740d953846794b42a3c2be4e45b65cdb) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:18.239257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.241126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.241572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 150/295] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:18.252404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 146/296] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/role_assignments?user.id=740d953846794b42a3c2be4e45b65cdb&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:18.276265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.386798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af131cc-e44c-45db-a1e1-491b09f5d3ba None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.432191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24ac26-e66a-4ed5-8b85-46de89366787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.433258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ac26-e66a-4ed5-8b85-46de89366787 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.433760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ac26-e66a-4ed5-8b85-46de89366787 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.434224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24ac26-e66a-4ed5-8b85-46de89366787 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.450087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24ac26-e66a-4ed5-8b85-46de89366787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-8e24ac26-e66a-4ed5-8b85-46de89366787 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:18.455415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:18.456325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:18.457154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:18.459709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 151/297] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:18.466902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.531882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422b616-0944-47f8-9430-8120de45a01d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.532185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422b616-0944-47f8-9430-8120de45a01d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.532350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422b616-0944-47f8-9430-8120de45a01d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.534040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 152/298] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:18.540851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.541169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.541391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.547323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.568014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:18.569288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:18.600770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96789726-263e-4dfd-bacb-a644735a0493 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.611816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.644692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.646994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.646994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.646994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.646994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:18.646994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.648181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.662429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 147/299] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:18.667878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.680880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 153/300] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:18.707749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.778867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c8465-a744-4ecd-8dde-a17ee0fc423b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.797738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.812853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50378ec9-5ae2-4947-b60b-2120d55bbf8f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.815909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacaf7e-92a9-4929-998e-68b7fc2d9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.816567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacaf7e-92a9-4929-998e-68b7fc2d9415 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.816840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacaf7e-92a9-4929-998e-68b7fc2d9415 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.817105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacaf7e-92a9-4929-998e-68b7fc2d9415 None admin] PATH_INFO: `/v3/users/a008b9febe4b4886b9090fdbdd324d72` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.832570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacaf7e-92a9-4929-998e-68b7fc2d9415 None admin] RBAC: Authorizing `identity:get_user(user_id=a008b9febe4b4886b9090fdbdd324d72)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.834049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacaf7e-92a9-4929-998e-68b7fc2d9415 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.840425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 148/301] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/users/a008b9febe4b4886b9090fdbdd324d72 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:18.840425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db183e-8099-48e0-9fc4-3bd2fc16111e None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.840425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db183e-8099-48e0-9fc4-3bd2fc16111e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.840425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db183e-8099-48e0-9fc4-3bd2fc16111e None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.840425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 149/302] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:18.843880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db183e-8099-48e0-9fc4-3bd2fc16111e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:18.857511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14fca7-d916-412f-bc47-ae8e50867590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:18.858237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14fca7-d916-412f-bc47-ae8e50867590 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.858576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14fca7-d916-412f-bc47-ae8e50867590 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.858824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14fca7-d916-412f-bc47-ae8e50867590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.860016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14fca7-d916-412f-bc47-ae8e50867590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:18.861512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14fca7-d916-412f-bc47-ae8e50867590 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:18.868194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 154/303] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:18.868194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:18.868194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:18.868194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:18.891740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:18.893059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:18.915948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:18.955208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db183e-8099-48e0-9fc4-3bd2fc16111e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:18.968699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 155/304] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:18.969772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.003121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.003735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.004011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.004276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.005043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] RBAC: Adding query filter params (role.id=f573691e90cc403d9084314ae7ee8b01, user.id=a008b9febe4b4886b9090fdbdd324d72, scope.system=all) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:19.005343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:19.006832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:19.012001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 150/305] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 9 12:09:18 2022] GET /identity/v3/role_assignments?user.id=a008b9febe4b4886b9090fdbdd324d72&scope.system=all&role.id=f573691e90cc403d9084314ae7ee8b01 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:19.017358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.080667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:19.098283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5ead9-21e7-4d8e-9c48-5fffde38f0ef None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.141398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.142504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.143071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.143537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] PATH_INFO: `/v3/groups` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.144479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:19.146430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:19.160669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79337a8-f6fb-454d-8344-3336bb0fa496 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.172040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 156/306] 10.222.0.60 () {60 vars in 1134 bytes} [Tue Aug 9 12:09:18 2022] POST /identity/v3/groups => generated 229 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:19.208570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.209278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.209563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.209921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.222566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:19.228070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:19.229082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:19.229884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:19.234361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 151/307] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:19.235911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.257343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:19.351017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592df9d-0879-4793-9198-109b6b148793 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.391058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.391704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.391920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.392188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.392911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:19.393207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:19.394579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cef6b-40f7-4d95-a3bb-41b1f2ce60c3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:19.403322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 157/308] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:19.409065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.453999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dd83c-4c9c-47f4-b473-a200d8c86b54 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.454333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dd83c-4c9c-47f4-b473-a200d8c86b54 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.454635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399dd83c-4c9c-47f4-b473-a200d8c86b54 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.457310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 158/309] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:19.462068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.462343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.462611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.484765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:19.486054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:19.529727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:19.534369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94161b81-3d70-491d-a6a3-e0b7bc1344c8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.569516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 159/310] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:19.571312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.572207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.572715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.573182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] PATH_INFO: `/v3/users/0741506ebecb45088ed2afc828c46232` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.574529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] RBAC: Authorizing `identity:get_user(user_id=0741506ebecb45088ed2afc828c46232)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:19.576183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:19.578247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 152/311] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:19 2022] GET /identity/v3/users/0741506ebecb45088ed2afc828c46232 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:19.587080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.594669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:19.595529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.708227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998c2e2-fb46-447e-afa7-1d4d06485808 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.715503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710777ca-1c98-4b33-9b9e-7a682265de80 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.746569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.747521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.747927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.748323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.759315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.759992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.760267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.760567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] PATH_INFO: `/v3/system/users/0741506ebecb45088ed2afc828c46232/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.762004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0741506ebecb45088ed2afc828c46232, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:19.763388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:19.764895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:19.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:19.774189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:19.774983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:19.777909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 160/312] 10.222.0.60 () {58 vars in 1334 bytes} [Tue Aug 9 12:09:19 2022] PUT /identity/v3/system/users/0741506ebecb45088ed2afc828c46232/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:19.778237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 153/313] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:19.783843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.865116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:19.899808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a1f3-b80a-42cb-b1fe-bc028c474d36 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:19.936418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:19.937054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:19.937331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:19.937599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:19.938275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:19.938576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:19.940035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:19.950121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 161/314] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:19.956117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:19.989400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.066838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a47c18-330d-473a-a13a-b8d3a3c1c431 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.102413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.103057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.103331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.103600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] PATH_INFO: `/v3/users/546d9faa97f14dedb4ff47a36d86637e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.104763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] RBAC: Authorizing `identity:get_user(user_id=546d9faa97f14dedb4ff47a36d86637e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:20.106209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:20.108090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 154/315] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:19 2022] GET /identity/v3/users/546d9faa97f14dedb4ff47a36d86637e => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:20.113477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.220173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c05c8f-8bff-4049-bf26-43cf13b60772 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.254057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.254718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.254999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.255269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.258148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.325809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:20.327287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:20.430487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 162/316] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:20.436406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.532437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.540846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d35bbe-59db-40f2-a90b-3ba4f1982e7b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.576018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeaaca2-0ea0-4b37-8db8-1c2a82f5f0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.577040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaaca2-0ea0-4b37-8db8-1c2a82f5f0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.577505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaaca2-0ea0-4b37-8db8-1c2a82f5f0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.577958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeaaca2-0ea0-4b37-8db8-1c2a82f5f0a8 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.579335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaaca2-0ea0-4b37-8db8-1c2a82f5f0a8 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:20.581015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeaaca2-0ea0-4b37-8db8-1c2a82f5f0a8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:20.582858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 155/317] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:20.589758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:20.626250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:20.694090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2d50e-6267-4042-9ecc-ebe9e9ff7460 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:20.728837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:20.729448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:20.729723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:20.729991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:20.730722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] RBAC: Adding query filter params (role.id=f573691e90cc403d9084314ae7ee8b01, scope.project.id=01376d53fad54cb09d721bfe77b948e8, user.id=546d9faa97f14dedb4ff47a36d86637e) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:20.731028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:20.732475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1a65e-45a8-46d6-b0dc-00e358539960 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:20.738792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 163/318] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:20 2022] GET /identity/v3/role_assignments?user.id=546d9faa97f14dedb4ff47a36d86637e&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=f573691e90cc403d9084314ae7ee8b01 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:21.036905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5986-17dc-489d-85fe-ed024aeb4fb2 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.037239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5986-17dc-489d-85fe-ed024aeb4fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.037507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf5986-17dc-489d-85fe-ed024aeb4fb2 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.038898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 156/319] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:21.044820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.045104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.045375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.064126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:21.065346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:21.132950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 164/320] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:21.155161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5986-17dc-489d-85fe-ed024aeb4fb2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.261405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf5986-17dc-489d-85fe-ed024aeb4fb2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.295170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e53f8-a5b1-43a7-be46-0b477cd56d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.295797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e53f8-a5b1-43a7-be46-0b477cd56d10 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.296069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e53f8-a5b1-43a7-be46-0b477cd56d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.296329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e53f8-a5b1-43a7-be46-0b477cd56d10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.306914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e53f8-a5b1-43a7-be46-0b477cd56d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-3d4e53f8-a5b1-43a7-be46-0b477cd56d10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:21.311634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:21.312862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:21.314768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 157/321] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:21.319056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.348686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.379212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79d84-aa8c-4272-8558-7e733f20bcf8 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.379553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79d84-aa8c-4272-8558-7e733f20bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.379823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc79d84-aa8c-4272-8558-7e733f20bcf8 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.381555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 158/322] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:21.386928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.387208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.387477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.405889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:21.406989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:21.425895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e443b19-cd89-44e6-adc1-dbbd9d29616d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.426092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.464201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.464944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.465105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.465385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.466580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:21.466888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.468298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.477419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 165/323] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:21.482533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.483234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 159/324] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:21.505428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.579295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.590908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212e96c-cb1a-4383-8a3d-faa75898d74b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.615944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba7a6-acd9-430b-8787-3d5bd6af019b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.626697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.627327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.627605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.627868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] PATH_INFO: `/v3/users/a008b9febe4b4886b9090fdbdd324d72` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.629036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] RBAC: Authorizing `identity:get_user(user_id=a008b9febe4b4886b9090fdbdd324d72)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.630530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.632160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 166/325] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/users/a008b9febe4b4886b9090fdbdd324d72 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:21.637661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.651129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.651766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.652036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.652296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.653405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.654841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.661547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 160/326] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:21.662595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:21.684147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:21.753918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bfb51-bed9-43bc-8257-09db629cd78b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.761800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa24b3-7c3a-4432-b171-2594ffef1c2f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:21.790955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5a317-9c2c-45a1-a5eb-096ea98fdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.791615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5a317-9c2c-45a1-a5eb-096ea98fdb6a None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.791888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5a317-9c2c-45a1-a5eb-096ea98fdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.792158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5a317-9c2c-45a1-a5eb-096ea98fdb6a None admin] PATH_INFO: `/v3/system/users/a008b9febe4b4886b9090fdbdd324d72/roles/f573691e90cc403d9084314ae7ee8b01` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.793656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5a317-9c2c-45a1-a5eb-096ea98fdb6a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a008b9febe4b4886b9090fdbdd324d72, role_id=f573691e90cc403d9084314ae7ee8b01)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.795041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5a317-9c2c-45a1-a5eb-096ea98fdb6a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.795915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00307d2-cfbb-4d8a-8418-7d6b2669bf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:21.796670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00307d2-cfbb-4d8a-8418-7d6b2669bf03 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.796857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00307d2-cfbb-4d8a-8418-7d6b2669bf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.797087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00307d2-cfbb-4d8a-8418-7d6b2669bf03 None admin] PATH_INFO: `/v3/groups` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.797716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00307d2-cfbb-4d8a-8418-7d6b2669bf03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:21.799112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00307d2-cfbb-4d8a-8418-7d6b2669bf03 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:21.812779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 167/327] 10.222.0.60 () {58 vars in 1334 bytes} [Tue Aug 9 12:09:21 2022] PUT /identity/v3/system/users/a008b9febe4b4886b9090fdbdd324d72/roles/f573691e90cc403d9084314ae7ee8b01 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:09:21.826837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 161/328] 10.222.0.60 () {60 vars in 1134 bytes} [Tue Aug 9 12:09:21 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:21.973683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633ee8-de50-4fff-bff0-cb82b42215cb None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.973914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633ee8-de50-4fff-bff0-cb82b42215cb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.974136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633ee8-de50-4fff-bff0-cb82b42215cb None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:21.975684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 168/329] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:21.981677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:21.981954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:21.982216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.003063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:22.004249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:22.075716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 162/330] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:22.098313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a633ee8-de50-4fff-bff0-cb82b42215cb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.126405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.211757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a633ee8-de50-4fff-bff0-cb82b42215cb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.247024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.247975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.248411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.248811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.260260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:22.266073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:22.267195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:22.268029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:22.268995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 169/331] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:22.276452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.291561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.391900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98812753-b9f4-4903-8fed-a9a9240081a6 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.427411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.428082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.428358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.428655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.429328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:22.429630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.431015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.444488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 163/332] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:22.445876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.539033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.558049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ec6e8-c70a-4bbe-9e98-4aaa11c8ffc9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.597727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a49eb-571b-4ffd-9415-c982361a7c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.598369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a49eb-571b-4ffd-9415-c982361a7c99 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.598644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a49eb-571b-4ffd-9415-c982361a7c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.598914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a49eb-571b-4ffd-9415-c982361a7c99 None admin] PATH_INFO: `/v3/users/0741506ebecb45088ed2afc828c46232` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.600412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a49eb-571b-4ffd-9415-c982361a7c99 None admin] RBAC: Authorizing `identity:get_user(user_id=0741506ebecb45088ed2afc828c46232)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.601861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a49eb-571b-4ffd-9415-c982361a7c99 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.603468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 170/333] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/users/0741506ebecb45088ed2afc828c46232 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:22.609540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:22.705698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:22.742155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4faf5-5f6f-47dd-975d-0d722ac63053 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:22.781438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:22.782044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:22.782322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:22.782576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:22.783298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] RBAC: Adding query filter params (role.id=912a71be4e054ba7ad73b96d8a48412e, user.id=0741506ebecb45088ed2afc828c46232, scope.system=all) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:22.783597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:22.785054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e50bf-5c8f-49be-9f07-60dd21786838 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:22.797636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 164/334] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 9 12:09:22 2022] GET /identity/v3/role_assignments?user.id=0741506ebecb45088ed2afc828c46232&scope.system=all&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:24.092211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812d7b-2cc4-4f04-9b75-ae20dde0d34c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.092768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812d7b-2cc4-4f04-9b75-ae20dde0d34c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.092768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95812d7b-2cc4-4f04-9b75-ae20dde0d34c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.094130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 171/335] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:24.099748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d49b-aae3-40b6-b82a-0df5a807d67a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.100230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d49b-aae3-40b6-b82a-0df5a807d67a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.100483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d49b-aae3-40b6-b82a-0df5a807d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.122416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9376d49b-aae3-40b6-b82a-0df5a807d67a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:24.123586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9376d49b-aae3-40b6-b82a-0df5a807d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:24.200150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 165/336] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:24.237935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812d7b-2cc4-4f04-9b75-ae20dde0d34c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.336442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50816-a8aa-4677-84f4-1bb0883b8e04 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.336771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50816-a8aa-4677-84f4-1bb0883b8e04 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.336979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50816-a8aa-4677-84f4-1bb0883b8e04 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.338328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 166/337] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:24.343472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.343753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.344025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.368687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95812d7b-2cc4-4f04-9b75-ae20dde0d34c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.370437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:24.371626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:24.426068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.426731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.427003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.427265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.447110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:24.460854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:24.461803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 12:09:24.462594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:24.465270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 172/338] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:24.467565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.472645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.493815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 167/339] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:24.498256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.594258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.627144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccce6e8-af48-4c7a-aadf-9a15266edae9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.713152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.713688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.713963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.714227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.714898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:24.715189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.716628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.730828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 173/340] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:24.736795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.773992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab6d55-23b3-47a6-903d-0926718f22b4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.843540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.844576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.845070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.845529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.868741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:24.870209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:24.874582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:24.875471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:24.876265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:24.879988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 168/341] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:24.901407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:24.917689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d52610-6e5e-4eef-85d9-38351d3d93af None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:24.957604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:24.958252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:24.958572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:24.959135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] PATH_INFO: `/v3/users/a008b9febe4b4886b9090fdbdd324d72` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:24.960176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] RBAC: Authorizing `identity:get_user(user_id=a008b9febe4b4886b9090fdbdd324d72)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:24.961775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:24.963482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 174/342] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/users/a008b9febe4b4886b9090fdbdd324d72 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:24.969666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.014911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.075835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080d575-dd4f-41fe-a34d-ea3d9e367038 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.104492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac2d0-d54e-49be-9915-8e8776e2b4ba None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.111078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.111686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.111962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.112229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.112990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] RBAC: Adding query filter params (role.id=f573691e90cc403d9084314ae7ee8b01, user.id=a008b9febe4b4886b9090fdbdd324d72, scope.system=all) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:25.113295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.114729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa257fd-f33f-4c1e-855f-671328874324 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.123962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.128770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 175/343] 10.222.0.60 () {56 vars in 1308 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/role_assignments?user.id=a008b9febe4b4886b9090fdbdd324d72&scope.system=all&role.id=f573691e90cc403d9084314ae7ee8b01 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:25.130003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea366ad-a805-4ef4-aeeb-ee57d9d80e00 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.130284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea366ad-a805-4ef4-aeeb-ee57d9d80e00 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.130557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea366ad-a805-4ef4-aeeb-ee57d9d80e00 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.135926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 176/344] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:25.137382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67852b5-87c1-401e-bf1d-6ee7fff2ad85 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.137663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67852b5-87c1-401e-bf1d-6ee7fff2ad85 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.137928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67852b5-87c1-401e-bf1d-6ee7fff2ad85 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.139590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 177/345] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:25.142445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.142445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.142445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.163854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:25.165847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:25.175395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.176451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.176918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.177468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.178493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:25.179100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.180763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22436275-bbee-46d0-83bb-aae2b539c14e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.192902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 169/346] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:25.194915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.195428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.195896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.218669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:25.220455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:25.250513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 178/347] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:25.251960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.304087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 170/348] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:25.305113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.404759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.430377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec97cd9-fce9-44d9-b5f0-294cd44b010a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.467897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.468983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd98c35-2a55-4ced-9339-660ff1e66b46 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.478348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.478965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.479238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.479940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.509994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.510632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.510902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.511161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.522384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:25.527213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:25.528114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:25.528956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:25.531030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 171/349] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:25.531849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.562539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.564323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.650786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d95a-fa09-4636-8a28-3a0ddc4427c4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.652361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.692959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 179/350] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:25.693306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.693618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.693785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.694110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.694527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.712469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:25.717314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:25.719502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 172/351] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:25.721728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.728365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:25.823586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddae5e3-1815-4e61-bb52-58679870d006 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.834995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a3f84-7450-4066-a91a-39d7de51373a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:25.868612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.869493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.869771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.870024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.870684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:25.870983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.872352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.873495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:25.874279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:25.874686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:25.875073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:25.876347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:25.877953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:25.879719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 173/352] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:25.887907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 180/353] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:25.891313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.896440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:25.933679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.003775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.012843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed24a4-8a0a-48ba-848e-92a4ff3fdd0a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.017992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa85124-4226-4ac1-b793-3bc29ae4208f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.057089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.057733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.058004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.058267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.064717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.065620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.065723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.066172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.066631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.067174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.067692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:26.068263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.069151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 181/354] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.069788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.070658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.081113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 174/355] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.082231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.198454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ff257-b6be-4974-bcde-bb0975e70d30 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.210631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.221284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae0d9f-b263-4542-a4cc-a599a06bc88d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.251885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425cd3c-3af4-4843-8eaa-77dfcdc4f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.252714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425cd3c-3af4-4843-8eaa-77dfcdc4f59c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.253092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425cd3c-3af4-4843-8eaa-77dfcdc4f59c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.253421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425cd3c-3af4-4843-8eaa-77dfcdc4f59c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.266066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.266994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.267271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.267535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.269217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=2e509ee5f9c2491794d91598205ffe49) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:26.269217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.270790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.278684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 175/356] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.279528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.283709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.349502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425cd3c-3af4-4843-8eaa-77dfcdc4f59c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.351813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425cd3c-3af4-4843-8eaa-77dfcdc4f59c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.422895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d636c-3442-4e14-a99e-072067e9e4e5 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.466658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d444a8-a184-4879-b55d-394aed8143b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.467385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d444a8-a184-4879-b55d-394aed8143b9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.467728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d444a8-a184-4879-b55d-394aed8143b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.468062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d444a8-a184-4879-b55d-394aed8143b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.494904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 182/357] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:26.496596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b27e18-c2df-4e77-8045-96d5a8f0f6c6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.497051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b27e18-c2df-4e77-8045-96d5a8f0f6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.497482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b27e18-c2df-4e77-8045-96d5a8f0f6c6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.498889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 183/358] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:26.501333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b27e18-c2df-4e77-8045-96d5a8f0f6c6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.501971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.571594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d444a8-a184-4879-b55d-394aed8143b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.573324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d444a8-a184-4879-b55d-394aed8143b9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.574297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.642482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b27e18-c2df-4e77-8045-96d5a8f0f6c6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.698254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19077ce9-d169-4806-8f21-a9168adc49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.699136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077ce9-d169-4806-8f21-a9168adc49d8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.699544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077ce9-d169-4806-8f21-a9168adc49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.699945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19077ce9-d169-4806-8f21-a9168adc49d8 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.701209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077ce9-d169-4806-8f21-a9168adc49d8 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.703055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19077ce9-d169-4806-8f21-a9168adc49d8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.705273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 184/359] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.706580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.707047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.707540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.722528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 176/360] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:26.725097 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ecc08-2f01-4a36-b373-19369a88ffcf None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.725432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ecc08-2f01-4a36-b373-19369a88ffcf None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.725671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ecc08-2f01-4a36-b373-19369a88ffcf None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.727245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 177/361] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:26.728008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ecc08-2f01-4a36-b373-19369a88ffcf None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.737420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:26.738053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:26.798243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.825170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 185/362] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:26.826338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:26.864993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ecc08-2f01-4a36-b373-19369a88ffcf None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:26.911469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:26.913964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c6810-c3c1-4629-816a-59b49d788f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:26.914615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6810-c3c1-4629-816a-59b49d788f7f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.914887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6810-c3c1-4629-816a-59b49d788f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.915148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c6810-c3c1-4629-816a-59b49d788f7f None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.916221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c6810-c3c1-4629-816a-59b49d788f7f None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:26.917710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c6810-c3c1-4629-816a-59b49d788f7f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:26.919278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 178/363] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:26.920355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:26.920708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:26.920965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:26.940023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:26.940757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:26.976181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08505d31-7320-49df-a88c-46eb2ec83da4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.016883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 179/364] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:27.017743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.018480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.019289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.019822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.020288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.021763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.023405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.025240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 186/365] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:26 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.026369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.082832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.143915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57b85-b57e-4f98-9d22-812f617ff9f8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.146370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ac761-bfed-4969-a0d4-96ec64525ac4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.170121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.188320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.188992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.189268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.189532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.190091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.190714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.190994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.191264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.191992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=01376d53fad54cb09d721bfe77b948e8) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.192304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.193856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.200987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 187/366] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.201542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.211033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:27.214682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:27.215563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:27.216372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 180/367] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:27.217075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.339783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14b86f-d868-4825-b067-3d7899182b05 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.362059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.371052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f864f49-7ee5-49ea-b58a-98014d9c5db0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.393209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.394247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.394718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.395862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.413498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:27.415241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.415897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.416175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.416460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.417625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.419095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:27.420880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:27.421760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:27.422561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:27.423173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 188/368] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.423173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.425260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 181/369] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:27.433019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.496325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.555546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38292d3-4733-4525-a204-fc6962e65027 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.579695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf435ac-6e39-4d0e-a0aa-2632a2add345 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.603712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.605926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.606411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.607110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.608290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.608782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.610984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.621770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 189/370] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.622800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.623306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.624015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.624416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.624766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.625861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=d4751935dff54d9f83198053a192832d, scope.project.id=2e509ee5f9c2491794d91598205ffe49) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.626621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.629507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.637629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 182/371] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=d4751935dff54d9f83198053a192832d => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.639027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.714052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.823142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab3779-cb27-415d-ab1e-96bd48001951 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.845267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bddf-c599-42b6-b2da-357d1bcce74a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:27.865690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:27.870849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.872089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.873101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.873847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.913339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:27.914124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:27.914499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:27.914868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:27.915634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:27.916197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.918556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:27.934291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 190/372] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:27.940494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:27.962880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:27.964698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.020956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.131804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 183/373] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:28.138419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.145889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10db23-64b9-46cc-a97b-b9982b46c3df None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.216805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.218101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.218510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.218909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.279023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.308066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.309807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.310216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a7723-d0bd-494b-be98-25def3ef82a7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.366277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.367107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.367480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.367849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.373125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.374702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.376521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 184/374] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.382789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.396338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.425436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 191/375] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:28.430814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.510231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3616c26-719a-4f6d-9875-32954a49344c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.533487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.562806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b12cb-53a9-4c35-b95e-8c35628a3b76 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.567055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b9b1b-995d-4ac9-bb4e-2795d4de544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.567823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b9b1b-995d-4ac9-bb4e-2795d4de544a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.568276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b9b1b-995d-4ac9-bb4e-2795d4de544a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.568663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b9b1b-995d-4ac9-bb4e-2795d4de544a None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.570105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b9b1b-995d-4ac9-bb4e-2795d4de544a None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.571647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b9b1b-995d-4ac9-bb4e-2795d4de544a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.576272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 185/376] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:28.576272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348a244-b3a5-46c2-9ee7-6fe0f5083544 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.576272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348a244-b3a5-46c2-9ee7-6fe0f5083544 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.576272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348a244-b3a5-46c2-9ee7-6fe0f5083544 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.576631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 186/377] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:28.579993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348a244-b3a5-46c2-9ee7-6fe0f5083544 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.606596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ae262-83d6-4969-8f65-ca4c1adaf4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.607246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae262-83d6-4969-8f65-ca4c1adaf4bc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.607521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae262-83d6-4969-8f65-ca4c1adaf4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.607789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae262-83d6-4969-8f65-ca4c1adaf4bc None admin] PATH_INFO: `/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.608999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ae262-83d6-4969-8f65-ca4c1adaf4bc None admin] RBAC: Authorizing `identity:get_project(project_id=865c26d1046a4242bbaffa7d1b6dfc7e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.610488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ae262-83d6-4969-8f65-ca4c1adaf4bc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.616725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 192/378] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:28.618324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50027-9144-455b-822c-ba91af146e6d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.618615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50027-9144-455b-822c-ba91af146e6d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.618886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50027-9144-455b-822c-ba91af146e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.638876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-12f50027-9144-455b-822c-ba91af146e6d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:28.640004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-12f50027-9144-455b-822c-ba91af146e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:28.675639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.713281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348a244-b3a5-46c2-9ee7-6fe0f5083544 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.726670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 193/379] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:28.727549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50027-9144-455b-822c-ba91af146e6d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.772811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.773424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.773699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.774022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.774752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=d4751935dff54d9f83198053a192832d, scope.project.id=01376d53fad54cb09d721bfe77b948e8) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:28.775105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.776577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.783799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 187/380] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=d4751935dff54d9f83198053a192832d => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.784749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.822065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:28.846419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50027-9144-455b-822c-ba91af146e6d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.906935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.907724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.908004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.908327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] PATH_INFO: `/v3/groups/55f66eafa0ae40faa76a68f108d85da4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:28.921505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] RBAC: Authorizing `identity:get_group(group_id=55f66eafa0ae40faa76a68f108d85da4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:28.922996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:28.926132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 194/381] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/groups/55f66eafa0ae40faa76a68f108d85da4 => generated 229 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:28.932323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:28.957193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368c047-42c6-4b3a-937b-14ee983dfa3c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:28.994957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:28.995736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:28.996021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:28.996333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.008699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:29.014255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:29.015189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:29.016336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:29.016967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.020532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 188/382] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:29.022454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.114539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639101a6-8702-4ecc-b786-fe690d7347a6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.128968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9c34c-9bd9-4a5a-9122-a498b1576386 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.164661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.165201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.165474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.165739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.166406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.166705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.167195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.167828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.168105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.168267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.168445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.169113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] RBAC: Adding query filter params (group.id=55f66eafa0ae40faa76a68f108d85da4, role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=865c26d1046a4242bbaffa7d1b6dfc7e) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:29.169517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.171053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.177359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 195/383] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:28 2022] GET /identity/v3/role_assignments?group.id=55f66eafa0ae40faa76a68f108d85da4&scope.project.id=865c26d1046a4242bbaffa7d1b6dfc7e&role.id=1e154845d18647eaa8a61129c3419d62 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:29.186899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 189/384] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:29.192581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.220791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.344364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98894b-ff65-440f-8821-7a8f06b09816 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.390826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.391461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.391736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.392005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.394885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.396394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.398050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 196/385] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.403590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.467845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.512649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40efdf-5cfb-4201-b5f8-61b4aaeb83d4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.549387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5e05d-8bb1-49d5-a7e9-f53679556bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.550086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e05d-8bb1-49d5-a7e9-f53679556bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.550407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e05d-8bb1-49d5-a7e9-f53679556bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.550720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5e05d-8bb1-49d5-a7e9-f53679556bf4 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.551850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5e05d-8bb1-49d5-a7e9-f53679556bf4 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.553418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5e05d-8bb1-49d5-a7e9-f53679556bf4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.555308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 190/386] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:29 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:29.561329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:29.642050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:29.675196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2160be6-f965-4ecf-84c6-01328f557201 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:29.713699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa47a04-8de1-4e46-83c4-9d6d5e7bfdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:29.714368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47a04-8de1-4e46-83c4-9d6d5e7bfdd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.714639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47a04-8de1-4e46-83c4-9d6d5e7bfdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.714906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47a04-8de1-4e46-83c4-9d6d5e7bfdd9 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.718762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa47a04-8de1-4e46-83c4-9d6d5e7bfdd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e509ee5f9c2491794d91598205ffe49, group_id=4dc20a3d8f1444ebbefebe68a4400c85, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:29.720265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa47a04-8de1-4e46-83c4-9d6d5e7bfdd9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:29.749990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 197/387] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:29 2022] PUT /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:29.911157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec42c2-5661-43e3-9549-ff481e28bd09 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.911488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec42c2-5661-43e3-9549-ff481e28bd09 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.911791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec42c2-5661-43e3-9549-ff481e28bd09 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.913826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 191/388] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:29.919198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:29.919740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:29.920207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:29.945586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:29.947124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:30.038399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 198/389] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:30.071580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec42c2-5661-43e3-9549-ff481e28bd09 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.192887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec42c2-5661-43e3-9549-ff481e28bd09 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.222479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.230810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f82d9-2e2f-4d5c-9a97-c71ff0063968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.231444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f82d9-2e2f-4d5c-9a97-c71ff0063968 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.231716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f82d9-2e2f-4d5c-9a97-c71ff0063968 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.231979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f82d9-2e2f-4d5c-9a97-c71ff0063968 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.245819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f82d9-2e2f-4d5c-9a97-c71ff0063968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f46f82d9-2e2f-4d5c-9a97-c71ff0063968 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:30.250738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:30.251636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:30.252538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 192/390] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:30.259237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.348109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8527350-4e59-4c9a-835c-5b63dacbcb90 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.348628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8527350-4e59-4c9a-835c-5b63dacbcb90 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.348956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8527350-4e59-4c9a-835c-5b63dacbcb90 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.349867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.350683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 193/391] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:30.357916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.358235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.358472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.392086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:30.393320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:30.405311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827472a1-c6e0-49e0-8823-22bcba4b0c37 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.445769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.446801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.447341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.447747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.448816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] RBAC: Adding query filter params (name=member) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:30.449252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.451326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.475717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 199/392] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:30.482665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.522225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 194/393] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:30.544842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.620280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523ae1b-ec40-4358-a0e2-93e24158028e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.648638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.672901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.673540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.673809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.674074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.675845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.677298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.679159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 200/394] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:30.681760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb69e8c-19c8-4ded-83e4-329da5847eab None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.685263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.715267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:30.742974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.744407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.745366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.745836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.761404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:30.767599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:30.768653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:30.769499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:30.770633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 195/395] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:30.777604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.871755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40abb-edd6-4ba0-b679-4a205b64e0d2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:30.949747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:30.950654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:30.950927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:30.951192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:30.954921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:30.956660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:30.959858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 201/396] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:30.965093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:30.980941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ba121-12ca-4142-9362-3d7a31bce910 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.034732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.036196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.036672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.037136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.038502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:31.038994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.040592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.054386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 196/397] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:31.062262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.066910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.142167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.159085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac796239-d417-426b-a7ae-3879c1c192c7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.222496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a3408-7cdb-460b-9137-b3b24c7c692b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.229092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.229994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.230437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.230860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.233653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] RBAC: Authorizing `identity:create_grant(project_id=01376d53fad54cb09d721bfe77b948e8, group_id=4dc20a3d8f1444ebbefebe68a4400c85, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.235275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.264286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.265053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.265770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.266494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.267862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.269583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.271609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 202/399] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:30 2022] PUT /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:09:31.272066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 197/399] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:31.278722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.397096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe126b-1335-4d14-bcba-622096d845d7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.405258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.433992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15055367-91bb-4013-aaee-0c543fb5b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.434725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15055367-91bb-4013-aaee-0c543fb5b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.434999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15055367-91bb-4013-aaee-0c543fb5b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.435307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15055367-91bb-4013-aaee-0c543fb5b8e1 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.436560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15055367-91bb-4013-aaee-0c543fb5b8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.438003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15055367-91bb-4013-aaee-0c543fb5b8e1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.439659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 198/400] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:31.445957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.588136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348a99b-d598-473f-90f3-063ba41c9318 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.608128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:31.614750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c6cc-1203-484f-a897-1b4d2c393c56 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.615442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c6cc-1203-484f-a897-1b4d2c393c56 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.615442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3c6cc-1203-484f-a897-1b4d2c393c56 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.621853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 199/401] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:31.630315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.631149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.631632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.634394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.635920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.635920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.635920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/d4751935dff54d9f83198053a192832d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.637734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e509ee5f9c2491794d91598205ffe49, group_id=4dc20a3d8f1444ebbefebe68a4400c85, role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:31.639164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:31.659687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 203/402] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:31 2022] PUT /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/d4751935dff54d9f83198053a192832d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:31.662338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:31.663569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:31.767839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 200/403] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:31.806463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:31.935267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc117ee-0f82-4dd2-9de0-40872e252ed9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:31.970018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd1f98-a262-4a0f-b724-ca02b2dffcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:31.971052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd1f98-a262-4a0f-b724-ca02b2dffcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:31.971537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd1f98-a262-4a0f-b724-ca02b2dffcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:31.971993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd1f98-a262-4a0f-b724-ca02b2dffcf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:31.982861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd1f98-a262-4a0f-b724-ca02b2dffcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2bfd1f98-a262-4a0f-b724-ca02b2dffcf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:31.988415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:31.989312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:31.990307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:31.993007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 204/404] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:32.000074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.079844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724dbee-99dd-4691-98f8-691a5748b948 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.080791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724dbee-99dd-4691-98f8-691a5748b948 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.081321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724dbee-99dd-4691-98f8-691a5748b948 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.084051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 205/405] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:32.091588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.092204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.092912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.119033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:32.120681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:32.168191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1729a-316e-41ed-84b3-6c66c4ac4d5a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.185765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.187744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.231912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.233009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.233859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.234545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.235397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:32.235896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.237484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.246858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 201/406] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:32.257782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.282150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 206/407] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:32.325518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.360987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c6cf-b31a-468c-9139-35101f813585 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.411357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.413625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.414115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.415347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.418795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.420502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.424463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 202/408] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:32.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.481908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.520876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec423e86-cfe3-4d08-ab43-8463157e141d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.581680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306acf-7326-4699-98f0-498c1125c026 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.588301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.589269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.589828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.590349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.618206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:32.625753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.626978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:32.627350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:32.628231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:32.629064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 207/409] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:32.630483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.631051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.632502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.634419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.634965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.636994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 203/410] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:32.642502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.700744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.754632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a0c8f-84a5-4cc0-b236-a73f06211a84 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.757727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:32.775667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c3d83-00fe-44dd-9f76-3c5199e3d5b9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:32.793413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c2492-3822-46cb-91f8-5e22ceec6033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.794476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c2492-3822-46cb-91f8-5e22ceec6033 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.794937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c2492-3822-46cb-91f8-5e22ceec6033 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.795385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c2492-3822-46cb-91f8-5e22ceec6033 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/d4751935dff54d9f83198053a192832d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.797765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c2492-3822-46cb-91f8-5e22ceec6033 None admin] RBAC: Authorizing `identity:create_grant(project_id=01376d53fad54cb09d721bfe77b948e8, group_id=4dc20a3d8f1444ebbefebe68a4400c85, role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.799405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c2492-3822-46cb-91f8-5e22ceec6033 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.812073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:32.812713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.812990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.813259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.813916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:32.814215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:32.815574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:32.815990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 204/411] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:32 2022] PUT /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8/groups/4dc20a3d8f1444ebbefebe68a4400c85/roles/d4751935dff54d9f83198053a192832d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:09:32.817685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e966c1-3350-4fd2-99a7-a39cce7f4f2d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.818165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e966c1-3350-4fd2-99a7-a39cce7f4f2d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.818810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e966c1-3350-4fd2-99a7-a39cce7f4f2d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.820353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 205/412] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:32.829290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:32.829629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:32.829840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:32.836332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 208/413] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:32.842032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:32.867083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:32.868342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:32.969648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 206/414] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:33.000909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.044071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.066180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c15f00-24dd-4bf6-ba0b-ca43c9fea408 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.128886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.138086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca107c-68c7-444b-9e99-f99e4a7b720d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.146090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.147381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.147671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.147935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] PATH_INFO: `/v3/groups/55f66eafa0ae40faa76a68f108d85da4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.149089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] RBAC: Authorizing `identity:get_group(group_id=55f66eafa0ae40faa76a68f108d85da4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.150516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.160680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 209/415] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/groups/55f66eafa0ae40faa76a68f108d85da4 => generated 229 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:33.161402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.183323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.186298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.186767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.187189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.212929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:33.222431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:33.223497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:33.224479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:33.229658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 207/416] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:33.236823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.325688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d1783-c07a-49a5-8049-b0e5994d77ad None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.360261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.360939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.361214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.361480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] PATH_INFO: `/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.364435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] RBAC: Authorizing `identity:get_project(project_id=865c26d1046a4242bbaffa7d1b6dfc7e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.364435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.366214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 210/417] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:33.371550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.404853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.464565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a7f6-cbf1-4eb2-b098-7016d73ced4a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.525595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.526207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.526479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.526746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.527410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:33.527704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.529107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.542541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 208/418] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:33.544760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887df02-ced0-4930-bf84-432f847c091b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.548455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:33.586114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.594646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77549505-daaf-466a-88ee-07f3bc253365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.595332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549505-daaf-466a-88ee-07f3bc253365 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.595617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549505-daaf-466a-88ee-07f3bc253365 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.595897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77549505-daaf-466a-88ee-07f3bc253365 None admin] PATH_INFO: `/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e/groups/55f66eafa0ae40faa76a68f108d85da4/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.599208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77549505-daaf-466a-88ee-07f3bc253365 None admin] RBAC: Authorizing `identity:create_grant(project_id=865c26d1046a4242bbaffa7d1b6dfc7e, group_id=55f66eafa0ae40faa76a68f108d85da4, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.600659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77549505-daaf-466a-88ee-07f3bc253365 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.634120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 211/419] 10.222.0.60 () {58 vars in 1442 bytes} [Tue Aug 9 12:09:33 2022] PUT /identity/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e/groups/55f66eafa0ae40faa76a68f108d85da4/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:33.698689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f222f8-b138-4ae0-868c-d736924b99ab None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:33.734721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:33.735345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.735621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.735891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.810266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:33.811737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:33.830303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:33.895095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64981-5cf3-48e5-829b-07ec1e861883 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.895379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64981-5cf3-48e5-829b-07ec1e861883 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.895641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e64981-5cf3-48e5-829b-07ec1e861883 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.898018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 212/420] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:33.904779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:33.905352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:33.905812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:33.924462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 209/421] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:33.925756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:33.927230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:33.937488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.025425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 213/422] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:34.054039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.060425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb1083-e703-4cda-bfc8-5de4f602f007 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.079802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.083063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.109510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178732-9f88-4e7e-b783-a1a1f1ac7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.110352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178732-9f88-4e7e-b783-a1a1f1ac7b6f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.110713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178732-9f88-4e7e-b783-a1a1f1ac7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.111131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178732-9f88-4e7e-b783-a1a1f1ac7b6f None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.112338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9178732-9f88-4e7e-b783-a1a1f1ac7b6f None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.114359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9178732-9f88-4e7e-b783-a1a1f1ac7b6f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.117248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 210/423] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:33 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.121344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f2e62-32d7-41aa-9a29-70dcc8f4189e None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.121787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f2e62-32d7-41aa-9a29-70dcc8f4189e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.122222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f2e62-32d7-41aa-9a29-70dcc8f4189e None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.125239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 211/424] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:34.126897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f2e62-32d7-41aa-9a29-70dcc8f4189e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.189333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca39c3-0828-4c25-9744-4c2c70612643 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.233000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca893d9-88a3-4895-879d-991b11763224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.233801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca893d9-88a3-4895-879d-991b11763224 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.234488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca893d9-88a3-4895-879d-991b11763224 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.234755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca893d9-88a3-4895-879d-991b11763224 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.247410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f2e62-32d7-41aa-9a29-70dcc8f4189e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.247758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca893d9-88a3-4895-879d-991b11763224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-cca893d9-88a3-4895-879d-991b11763224 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:34.253768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:34.254684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 12:09:34.255625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:34.260353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 214/425] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:34.261768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.262051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.262322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.286891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:34.288409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:34.289543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.290456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.290932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.291383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.292803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.294506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.296645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 212/426] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.297705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.357421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.388640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 215/427] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:34.390239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.404705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.426997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967955-6e97-4d8d-b2d0-0e2fceb08d1d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.471166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.471846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.472210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.472606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.473357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.473756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.475589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.484505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 213/428] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.489562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.523697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ead0-04b5-415f-8d07-812fddd74907 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.558400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.558974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.559343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.559831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.560627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=2e509ee5f9c2491794d91598205ffe49) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.561027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.562564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.573339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 216/429] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.573339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.637683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e91fc-bf9b-4aee-8052-7170161ed1ec None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.668049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.707468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.708275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.708749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.709110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.718095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:34.734248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:34.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:34.740626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:34.741440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:34.742537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 214/430] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:34.748834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.793830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde7dcbe-b317-426d-9d4b-a36927c6fee8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.841753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.842361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.842692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.842960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.874200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac35f1-acb9-4e37-b5a6-c6b5f0372bb9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:34.919791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:34.921298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:34.921748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:34.922435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:34.923507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:34.923978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.926105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.931308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:34.932894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:34.938338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 215/431] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:34.945231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:34.993825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.015242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.057908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 217/432] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:35.063703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.082688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea675269-114b-458a-bf76-04221fbe25e3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.119589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bd56b-54ee-49f1-8317-f41ab4946295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.120199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd56b-54ee-49f1-8317-f41ab4946295 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.120500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd56b-54ee-49f1-8317-f41ab4946295 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.120765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bd56b-54ee-49f1-8317-f41ab4946295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.186887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8fea0-21e8-4d66-b0f0-5e277daff9d3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.200523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bd56b-54ee-49f1-8317-f41ab4946295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.202087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bd56b-54ee-49f1-8317-f41ab4946295 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.231570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.232799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.233473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.233910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.235828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.238094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.240539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 218/433] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:35.243475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.248721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.299300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.327743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 216/434] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:35.333490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23fb0-effb-4f8e-a729-44a340dc8e0b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.334171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23fb0-effb-4f8e-a729-44a340dc8e0b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.334620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23fb0-effb-4f8e-a729-44a340dc8e0b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.336403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 217/435] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:35.338110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23fb0-effb-4f8e-a729-44a340dc8e0b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.369981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f2355-9da0-4766-8be3-423d1896a55b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.410904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26156e5d-4b88-4425-abf7-7fca36619905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.411724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26156e5d-4b88-4425-abf7-7fca36619905 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.411885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26156e5d-4b88-4425-abf7-7fca36619905 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.413589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26156e5d-4b88-4425-abf7-7fca36619905 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.414328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26156e5d-4b88-4425-abf7-7fca36619905 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.415773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26156e5d-4b88-4425-abf7-7fca36619905 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.417764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 219/436] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.418982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.419262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.419526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.439677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:35.440880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:35.481632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23fb0-effb-4f8e-a729-44a340dc8e0b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.516143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 220/437] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:35.517307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.526477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.527166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.527435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.527724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] PATH_INFO: `/v3/projects/2e509ee5f9c2491794d91598205ffe49` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.529381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] RBAC: Authorizing `identity:get_project(project_id=2e509ee5f9c2491794d91598205ffe49)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.531403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.538235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 218/438] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/projects/2e509ee5f9c2491794d91598205ffe49 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.538780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.544030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.559651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.627198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20137035-a4aa-467b-a76f-52dc335e7f5f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.651491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3293cb4-264f-4e66-8e02-4eb0aee39107 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.664783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.665785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.666075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.666346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.667078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=912a71be4e054ba7ad73b96d8a48412e, scope.project.id=01376d53fad54cb09d721bfe77b948e8) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.667381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.668847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.675461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 221/439] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=912a71be4e054ba7ad73b96d8a48412e => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.677182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.690762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.692317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.692764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.693612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.711176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:35.719544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:35.720706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:35.721734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:35.725258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 219/440] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:35.731250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.804211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.809542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:35.813233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf24d76-bf1d-4e40-962c-62f53a3ce1c6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.846739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3514c68-d09d-4a57-b1dd-338128fde514 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:35.855920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.856979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.857315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.857648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.858955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.860535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.862646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 222/441] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:35.868449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.894166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:35.895182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:35.895657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:35.895954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:35.899167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:35.899167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:35.899167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:35.907369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 220/442] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:35.913161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:35.996333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fa674-3283-4ff6-8e94-5c2f7e59e2b0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.017993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fac0d-1de1-4d28-95c2-dd5a3ab136e4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.032366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.033013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.033290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.033559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.034285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=d4751935dff54d9f83198053a192832d, scope.project.id=2e509ee5f9c2491794d91598205ffe49) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.034595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.036034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593ff82a-89d3-43e3-a1a2-bd9e35f9b2e3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.042223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 223/443] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=2e509ee5f9c2491794d91598205ffe49&role.id=d4751935dff54d9f83198053a192832d => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:36.043251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8213-0019-44e0-8d82-46e537d1f843 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.043532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8213-0019-44e0-8d82-46e537d1f843 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.043799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d8213-0019-44e0-8d82-46e537d1f843 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.045164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 224/444] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:36.052317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.054048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.054162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.054289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.065784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.066415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.066690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.066976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.073100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:36.074342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:36.104844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.147057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.148199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.150855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 225/445] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:36.173986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.257206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 221/446] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:36.263403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.286212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad50ddd-bf5c-4f9b-ab66-a23c7eda3b37 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.296000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.329200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.329749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.330018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.330279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.342574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:36.347268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:36.348161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:36.348998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 226/447] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:36.356521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.386766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.395163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a67550-9402-4e5a-bfd4-039dfee43b0d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.432976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.433605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.433876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.434138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] PATH_INFO: `/v3/projects/01376d53fad54cb09d721bfe77b948e8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.435236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] RBAC: Authorizing `identity:get_project(project_id=01376d53fad54cb09d721bfe77b948e8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.438526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.438526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 222/448] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/projects/01376d53fad54cb09d721bfe77b948e8 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:36.444666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.477873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af989f-7c7b-4c44-9b7d-71e8064f6ffe None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.527299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.527909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.528179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.528467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.529120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.529417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.530783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.541720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 227/449] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:36.548062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.552231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.557851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15748e26-582b-47e9-b301-49502d1cd594 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.596466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.597005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.597274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.597538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] PATH_INFO: `/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.598638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] RBAC: Authorizing `identity:get_group(group_id=4dc20a3d8f1444ebbefebe68a4400c85)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.600237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.601884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 223/450] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/groups/4dc20a3d8f1444ebbefebe68a4400c85 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:36.607869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.638214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.655333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da528b26-9c16-4ee9-854a-72ab78482949 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.687270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.687869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.688146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.688421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.703721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe254a-363b-4ef4-ab1f-9b2d0fdae699 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:36.737471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:36.738065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:36.738318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:36.738581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:36.739297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] RBAC: Adding query filter params (group.id=4dc20a3d8f1444ebbefebe68a4400c85, role.id=d4751935dff54d9f83198053a192832d, scope.project.id=01376d53fad54cb09d721bfe77b948e8) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:36.739601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.741163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.746857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 224/451] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/role_assignments?group.id=4dc20a3d8f1444ebbefebe68a4400c85&scope.project.id=01376d53fad54cb09d721bfe77b948e8&role.id=d4751935dff54d9f83198053a192832d => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:36.751986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:36.753493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:36.856024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.874287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 228/452] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:36.880240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:36.910744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:36.987742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa489a-d1a0-4371-ae33-97a5b5f34102 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.023114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.023749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.024020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.024283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] PATH_INFO: `/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.025475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] RBAC: Authorizing `identity:get_project(project_id=865c26d1046a4242bbaffa7d1b6dfc7e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.026905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.028592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 225/453] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:09:36 2022] GET /identity/v3/projects/865c26d1046a4242bbaffa7d1b6dfc7e => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:37.034797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.151652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62736e06-066e-4673-842b-8ef2ca18550d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.189920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9f45-7684-437d-b033-5a3d6860a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.190546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9f45-7684-437d-b033-5a3d6860a4de None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.190819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9f45-7684-437d-b033-5a3d6860a4de None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.191080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9f45-7684-437d-b033-5a3d6860a4de None admin] PATH_INFO: `/v3/groups/55f66eafa0ae40faa76a68f108d85da4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.192281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9f45-7684-437d-b033-5a3d6860a4de None admin] RBAC: Authorizing `identity:get_group(group_id=55f66eafa0ae40faa76a68f108d85da4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.194045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9f45-7684-437d-b033-5a3d6860a4de None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.195639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 229/454] 10.222.0.60 () {56 vars in 1180 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/groups/55f66eafa0ae40faa76a68f108d85da4 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:37.202151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:37.313643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:37.322267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b68d5-cf55-4ab9-ab80-47a36e8bea33 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:37.369384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:37.369977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:37.370247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:37.370552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:37.371227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] RBAC: Adding query filter params (group.id=55f66eafa0ae40faa76a68f108d85da4, role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=865c26d1046a4242bbaffa7d1b6dfc7e) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:37.371528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:37.372989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0937-98c1-4bd5-ab69-7b5e11ad4ffc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:37.379592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 226/455] 10.222.0.60 () {56 vars in 1376 bytes} [Tue Aug 9 12:09:37 2022] GET /identity/v3/role_assignments?group.id=55f66eafa0ae40faa76a68f108d85da4&scope.project.id=865c26d1046a4242bbaffa7d1b6dfc7e&role.id=1e154845d18647eaa8a61129c3419d62 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:39.869577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99df9-37d0-4d36-861c-696e07e5dd0b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.870105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99df9-37d0-4d36-861c-696e07e5dd0b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.870105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99df9-37d0-4d36-861c-696e07e5dd0b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.871703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 230/456] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:39.877217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efa8c-169b-41a5-af30-9f8b8949f3bf None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:39.877635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efa8c-169b-41a5-af30-9f8b8949f3bf None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:39.877802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2efa8c-169b-41a5-af30-9f8b8949f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:39.901407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-aa2efa8c-169b-41a5-af30-9f8b8949f3bf None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:39.902622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-aa2efa8c-169b-41a5-af30-9f8b8949f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:39.990969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 227/457] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:40.034445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99df9-37d0-4d36-861c-696e07e5dd0b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.097105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.132980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4df2-570d-4e73-ba5f-ce9aeaa1a472 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.133159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4df2-570d-4e73-ba5f-ce9aeaa1a472 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.133430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af4df2-570d-4e73-ba5f-ce9aeaa1a472 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.135131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 228/458] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:40.139943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bcc17-2dce-478b-9d46-def9b1b4b40c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.140831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bcc17-2dce-478b-9d46-def9b1b4b40c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.141316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bcc17-2dce-478b-9d46-def9b1b4b40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.161669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b34bcc17-2dce-478b-9d46-def9b1b4b40c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:40.163450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b34bcc17-2dce-478b-9d46-def9b1b4b40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:40.168391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc99df9-37d0-4d36-861c-696e07e5dd0b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.221519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.222458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.222968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.223430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.234149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.236035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:40.251401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:40.252368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:40.253304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:40.253304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.253304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:40.255414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 231/460] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:40.255566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 229/460] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:40.260112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3100-991b-40c1-89da-ce8d8c176aa2 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.260112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3100-991b-40c1-89da-ce8d8c176aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.260112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac3100-991b-40c1-89da-ce8d8c176aa2 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.261407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.262843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 230/461] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:40.264287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.264592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.264863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.283710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:40.284914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:40.306755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.364494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 231/462] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:40.365808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.383277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0bd2ef-3f1e-4df0-a912-dc5c3c8591e0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.393117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.423512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.424486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.424925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.425331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.426136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.426595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.429244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.447492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 232/463] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:40.448959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.492619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094482e-4274-4c51-a26c-ba7587901b41 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.530114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.531278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.531771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.532233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.543265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.545038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.554697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:40.562723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:40.565260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:40.566140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:40.566140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.566140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:40.566140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 232/464] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:40.569656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.577911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19c409-9056-4f23-869c-924f497976cd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.623939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.624914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.625359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.625822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.639757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.642589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:40.662452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:40.663418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:40.664259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:40.664259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:40.664259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:40.670536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 233/465] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:40.670536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.686442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233772b-b6c6-4230-bae9-89b08d3c194c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.690291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.730630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.731792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.732238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.732707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.734084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.735959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.774188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 233/466] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:40 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:40.775047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.795541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a702ada-62a8-4902-b830-43b732772193 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.851006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.852112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.852112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.852278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.852878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.853183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.854610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3ad50-8064-446d-8e39-ace9b6ec7274 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.857912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.870330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 234/467] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:40.877605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed246b0-b84e-48f8-9b4a-3a40ef80de8b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.877910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed246b0-b84e-48f8-9b4a-3a40ef80de8b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.878124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed246b0-b84e-48f8-9b4a-3a40ef80de8b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.879875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 235/468] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:40.885023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed246b0-b84e-48f8-9b4a-3a40ef80de8b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:40.922341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb126-8a31-4578-b98c-5c54830b6a39 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:40.968715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:40.969219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.969498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.969767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:40.970614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:40.970716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:40.972363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807b7d1-d6e3-4c1f-96c0-4e276a94dc51 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:40.983462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:40.985799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 234/469] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:40.987402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:40.987683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:40.987952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.009777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:41.009981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:41.017711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed246b0-b84e-48f8-9b4a-3a40ef80de8b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.066710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.067329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.067606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.067935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.068627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.070069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.087682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 235/470] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:41.088870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.102718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 236/471] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:40 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:41.139344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.168499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.278646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4533a-132c-4443-ba69-32b3f99f8e36 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.309451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c8e2-bb02-4e91-adb7-ea923908424d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.324031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51a8cf-4511-4bdb-b430-558daed076bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.325118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a8cf-4511-4bdb-b430-558daed076bb None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.325726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a8cf-4511-4bdb-b430-558daed076bb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.326188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51a8cf-4511-4bdb-b430-558daed076bb None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.327035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51a8cf-4511-4bdb-b430-558daed076bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.328984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51a8cf-4511-4bdb-b430-558daed076bb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.342276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.350881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.351885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.353222 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.353704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.364572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 236/472] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:41 2022] POST /identity/v3/users => generated 248 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:41.366170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553bc60-d001-44f6-90cf-66f33209ca15 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.366457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553bc60-d001-44f6-90cf-66f33209ca15 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.366723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553bc60-d001-44f6-90cf-66f33209ca15 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.368861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 237/473] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:41.373878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.374657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.374941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.375209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.376529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:41.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:41.398111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:41.398950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:41.398950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:41.398950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:41.399121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:41.399722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:41.401790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 237/474] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:41.408492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.481090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 238/475] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:41.506015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.527514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee59d1-9a96-4741-bc9c-2116d8c016d8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.542216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.568790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.569556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.569934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.570306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.571053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:41.571472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.576446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.589849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 238/476] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:41.595438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.636673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b3219-2e6f-400a-a69b-6cfb643f6d2f None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.648499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.680792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.681655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.681928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.682589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.683534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.685246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.698349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.sql.core [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 12:09:41.698349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 12:09:41.698349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [parameters: {'id': 'e6dca0a538b64746b4a3acead2007b74', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 12:09:41.698349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result.read() Aug 09 12:09:41.719811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:09:41.720775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application yield resource Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise self.value Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application session.commit() Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 12:09:41.721680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.session.flush() Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application compat.raise_( Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 12:09:41.722520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:09:41.724755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result.read() Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:09:41.726656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [parameters: {'id': 'e6dca0a538b64746b4a3acead2007b74', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:41.732744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 12:09:41.733766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:41.734908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 239/477] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 9 12:09:41 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:41.734908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:41.735135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493f5d3-9285-411d-9010-41db66fdd38b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.779170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.780301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.780637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.780903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.781694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:41.783770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:41.822560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 239/478] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:41 2022] POST /identity/v3/users => generated 249 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:09:41.865305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:41.872700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca9543-3f97-447e-91f1-c8415d2369f4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:41.925198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a3241-d9c2-4928-a245-5243614d042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:41.925857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a3241-d9c2-4928-a245-5243614d042e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:41.926118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a3241-d9c2-4928-a245-5243614d042e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:41.926385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a3241-d9c2-4928-a245-5243614d042e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:41.939014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a3241-d9c2-4928-a245-5243614d042e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-1b0a3241-d9c2-4928-a245-5243614d042e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:41.944179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:41.945210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:41.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 240/479] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:41.954971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:42.119807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:42.123925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf26ee-047e-4f06-9937-81da3a2f4d03 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:42.164294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:42.164955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:42.165229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:42.165496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:42.166308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:42.166612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:42.168003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230f94-cdf0-43d7-bf13-8d76bdd3b1f0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:42.177504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 240/480] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:43.138561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d39788-db33-44d2-93ac-f28a0d0abb90 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.139079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d39788-db33-44d2-93ac-f28a0d0abb90 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.139079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d39788-db33-44d2-93ac-f28a0d0abb90 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.141729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 241/481] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:43.147210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.147632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.147806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.166039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:43.167220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:43.240762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 241/482] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:43.261277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d39788-db33-44d2-93ac-f28a0d0abb90 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.370586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d39788-db33-44d2-93ac-f28a0d0abb90 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.425741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.426300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.426572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.426835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.442501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:43.447204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:43.448130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:43.448988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:43.452736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 242/483] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:43.454499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.647791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.657544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fe8ed-e66d-4d68-9155-32c09c3ac6cc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.709285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.709804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.710075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.710341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.710995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:43.711291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.712670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df3f503-1bd3-467b-8c25-45631d7cfcf4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.723681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 242/484] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:43.729273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:43.753608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:43.821800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4ce3c-79a7-4264-829d-f1960ca42c48 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.822115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4ce3c-79a7-4264-829d-f1960ca42c48 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.822339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4ce3c-79a7-4264-829d-f1960ca42c48 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.823951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 243/485] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:43.830194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643806bd-e648-43fd-9932-3a3f6d88b1e6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.830475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643806bd-e648-43fd-9932-3a3f6d88b1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.830746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643806bd-e648-43fd-9932-3a3f6d88b1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.862934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-643806bd-e648-43fd-9932-3a3f6d88b1e6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:43.865236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb76ab-38f7-449d-b29c-b04c0c3b2921 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:43.867571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-643806bd-e648-43fd-9932-3a3f6d88b1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:43.922276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:43.922918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:43.923191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:43.923455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:43.948396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:43.949883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:43.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:43.976455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:43.977715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:43.977715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:43.977715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:43.977715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 243/486] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:43.982857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.018928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 244/487] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:44.080795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.093759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf07c9e-1dfe-4540-9b2b-a98514548641 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.094058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf07c9e-1dfe-4540-9b2b-a98514548641 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.094299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf07c9e-1dfe-4540-9b2b-a98514548641 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.096102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 245/488] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:09:44.096639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf07c9e-1dfe-4540-9b2b-a98514548641 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.125873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f264885-daca-41b8-973e-85bb5e3a36f8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.161782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.163280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.163790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.164260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.165165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.165840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.167534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f086-08be-4120-a68d-2d21763e3b46 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.180560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 244/489] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:44.182144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.182630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.183079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.201375 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:44.202915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:44.204895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.227275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf07c9e-1dfe-4540-9b2b-a98514548641 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.273227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.273853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.274119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.274376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.282616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 245/490] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:44.289242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.289740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:44.295147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.296065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:44.296924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:44.300341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 246/491] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.312204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.363413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.408808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fb44a-8da1-4e9b-89ee-91ea39b89e43 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.437861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e2df55-2e5b-4501-9a6b-6b4cfbfbd631 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.444037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.444691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.444962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.445224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.452820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.454274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:44.467915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.474043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 246/492] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.475183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.480976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.481599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.481940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.482270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.483000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.483361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.485092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b493b2e-8e0d-4648-b448-6ffbcdd49552 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.493686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 247/493] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:44.495118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899e20-e56e-4ec2-9555-77314c3abea3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.495469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899e20-e56e-4ec2-9555-77314c3abea3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.495823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899e20-e56e-4ec2-9555-77314c3abea3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.500443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 248/494] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:44.500443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899e20-e56e-4ec2-9555-77314c3abea3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.510362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.582355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b043-79bb-437c-95c5-7fd4f1de6758 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.599795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.608848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899e20-e56e-4ec2-9555-77314c3abea3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.619440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.620231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.620920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.621422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.634434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:44.641722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.642785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:44.643611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 247/495] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.644283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.650234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.650840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.651112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.651374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.652103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.652420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.653849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31e0402-0e57-408d-83b1-3f8726856ce8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.696252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 249/496] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:44.696252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.696252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.696252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.711036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:44.712215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:44.757400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e8c70a-5362-4bc1-bcfd-3548d2265e0f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.773623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.788419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 250/497] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:44.788419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.803061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.803778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.804117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.804471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.815874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.817433 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:44.831595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:44.832742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:44.833973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:44.833973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:44.833973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:44.833973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 248/498] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:44.833973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.863109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:44.895552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec462a67-7256-4f82-b8d5-f2e799c112e9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.928638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.929230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.929501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.929767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.930423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:44.930724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:44.932104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:44.937129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda01d9-7e56-45fa-95ea-76a713bf9b14 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:44.939666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 251/499] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:44.940459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:44.969652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:44.970522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:44.970859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:44.971128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:44.998155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.038522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.039903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.043453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f7cbf-4f02-41ff-be6c-104f6c5acbd2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.067936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.078645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3f00-0993-4877-a81c-0b3e1640cfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.079704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3f00-0993-4877-a81c-0b3e1640cfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.080182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3f00-0993-4877-a81c-0b3e1640cfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.080743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3f00-0993-4877-a81c-0b3e1640cfc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.092122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3f00-0993-4877-a81c-0b3e1640cfc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-85bf3f00-0993-4877-a81c-0b3e1640cfc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:45.097232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.098310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:45.099179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 252/500] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.100213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ad4b-6b63-4d0c-a678-70bcca9e0f64 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.100509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ad4b-6b63-4d0c-a678-70bcca9e0f64 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.100774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5ad4b-6b63-4d0c-a678-70bcca9e0f64 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.101980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 253/501] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:45.102653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5ad4b-6b63-4d0c-a678-70bcca9e0f64 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.147816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 249/502] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:45.148691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.208960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5ad4b-6b63-4d0c-a678-70bcca9e0f64 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.224717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.243019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.243624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.243899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.244165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.244399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ba816-d31d-47b7-872d-b106878576ba None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.244830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.245123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.246521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.257922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 254/503] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.258705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.277181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.282831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.283468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.283738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.283998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.294140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.295545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-aaebeda0-f49f-48b9-8677-9257ef73e12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:45.310131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.311043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:45.311889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:45.311889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.311889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:45.315993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 250/504] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.317092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.317372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.317643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.335163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:45.336345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:45.358277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec277e2-21e0-49d9-8c61-a8e8b3b4dae7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.392423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.393028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.393304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.393570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.394245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.394542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.396077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.402815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 251/505] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:45.403670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.409370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 255/506] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.409370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.448113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.507664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256206a-078f-446a-9423-2c8e4bbe83fe None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.510818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005253-e649-4828-8c0e-5decbd50277b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.521618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.545722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.546243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.546513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.546606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.546778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.547165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.547440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.547700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.554341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.555781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.557564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.558992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:45.568904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.569823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:45.570988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 256/507] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.571722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:45.572943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.573834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:45.575626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:45.575626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.575626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:45.575626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 252/508] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.575626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.669435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.673127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d10e7-a8fc-49b2-9485-e619804bea40 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.674328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b799e2-942b-45f8-b913-00452a021c15 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.707072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.707343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.707733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.707968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.708060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.708435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.708537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.708617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.708906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.709244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.710600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.718858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.720277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.722393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 257/509] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.723186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:45.741026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.742115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:45.743121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:45.743121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.743121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:45.743459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 253/510] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.744262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.762237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.823225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc4d64-9902-4ac7-8545-f4d46586a1e9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.844940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d6d0-3ef3-461b-a4c7-f654cfb5fd10 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:45.855933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.856579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.856853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.857119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.867791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.869290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.878760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:45.879366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:45.879641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:45.879905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:45.880774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:45.881084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:45.882503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:45.884145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:45.885065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:45.885915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:45.885915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:45.885915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:45.885915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 258/511] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:45.886713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.901030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:45.925238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 254/512] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:45.926074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:45.991575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092edd8-3a6f-4b7e-91e1-fc84efa1f79e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.001550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.025528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.026122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.026394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.026656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.027281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.027390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910751f5-1c07-44df-96d8-368cd4a2e56f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.027577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.028999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.040328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 259/513] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.041130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.065211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.065874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.066152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.066416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.073894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.075296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:46.086340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.087382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 255/514] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.088519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.110810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.143632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513043dd-3601-463c-8a91-ab7ebdbb2a3c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.177487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.178081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.178356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.178628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.179262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.179562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.180997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.189725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f5e0d-9680-4989-a290-cf0f22196cfa None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.192024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 260/515] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.192898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.224784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.225387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.225657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.225916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.226546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.226843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.228201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.229622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.241073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 256/516] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.241863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.295337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ca4c8-30a3-46c0-9008-c3e74ac930f3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.324168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.330582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.331218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.331468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.331737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.337332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fbbfd-5bfb-471f-92d7-8e98b6c3dd0a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.370447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.371074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.371350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.371618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.378109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.379547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:46.391234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.392096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 257/517] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.393182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.400851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.402329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.446734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.492289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa82de4-8bd8-4776-8c72-747ed63c72b5 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.500491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 261/518] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:46.501330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.526797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.527400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.527670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.527928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.528673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.528964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.530389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.531504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.547909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 258/519] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.552832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.606985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c3796-366d-4bbe-a7ba-e09720c42f60 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.640697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.641342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.641596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.641860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.648862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.650303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.651816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41eb2d9-d564-4298-89fe-f433c3239d5f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:46.662297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.663320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 262/520] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.669105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.670298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.687021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.687672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.687946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.688228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.688886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.690316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.711310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 259/521] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:09:46 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:09:46.712115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.766720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.778084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7eb7-7241-4d1a-916f-90b2ba60a9d7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.818575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.819195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.819468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.819727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.820560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:46.820932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.822424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.826944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a06f2f-2a63-487d-b73d-69cfab226fa2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:46.843127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 263/522] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:46.844358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.871614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:46.872164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:46.872485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:46.873064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:46.885589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:46.887074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:46.903258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:46.904199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:46.906272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:46.906272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:46.906272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:46.906272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 260/523] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:46.906886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:46.937368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:46.969436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a756ce0-a67b-4d36-9e0c-a4c6508615d9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.006614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.007227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.007502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.007768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.022478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab446718-0659-4f0a-99ae-8f8a70f200cc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.026985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.059656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.060530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.060955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.061217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.061939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.062237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.063653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.077324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.078772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.085759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 261/524] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.085759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.162685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.183744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 264/525] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:47.184656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.185773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efc0fc-c747-416c-9b8f-2135c09b93d3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.223262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.224330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.224824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.225223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.226225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=2d6406240f104443b75c8ec7d7999070) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.226701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.228302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.233993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 262/526] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/role_assignments?user.id=2d6406240f104443b75c8ec7d7999070&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.234920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.254990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.322982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e07fad-f69a-4572-96c9-b6366e607fa1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.368071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e982fd-ad56-403a-8279-2748e4567f37 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.373575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.374467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.374878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.375297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.376077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.377230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.378812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.397878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 265/527] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.398762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.412502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.413700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.413917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.414181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.488768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.506028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38455e06-0a4b-49bd-b5bb-4ac187c42339 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.508023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.510585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.518373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.544849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.545628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.546021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.546455 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.560849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.562537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:47.581884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:47.583005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:47.584660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:47.584660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:47.584660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:47.586733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 266/528] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:47.588349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.642059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 263/529] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:47.643184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.687434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.718661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d68b3-4843-47db-ac59-69523d62d112 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.748269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf785955-b5ad-4e8a-a14d-8911bc336ef8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.763294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.764603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.765607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.766035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.775246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.777408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.787306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.787919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.788190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.788483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.789127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.789423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.790868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:47.792706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:47.793698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:47.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:47.800729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 267/530] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:47.800729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.814142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 264/531] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:47.815391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:47.828268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.927805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b9756-d784-4ec3-8a14-8f2ad82266ff None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.953366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541050d1-c778-4f25-a5ab-6ccefe700d9b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:47.955847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:47.967086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.967949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.968498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.968916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.980903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.982620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:47.995577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:47.996262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:47.996642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:47.996972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:47.997723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:47.998085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:47.999581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:48.000020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:48.001122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:48.001988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:48.001988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:48.001988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:48.008460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 268/532] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:48.009503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.024448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 265/533] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.025623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.093073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.119427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac0806-6910-4115-9639-369c897ed96f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.132362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698e997-9f18-4431-9aee-b2dab0ceb527 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.154908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.155609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.155800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.156067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.163573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.165351 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.170393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.171245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.171709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.172203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.173066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.173562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.175170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:48.177128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:48.178074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:48.178908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 269/534] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:48.179360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.196742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 266/535] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.197973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.224487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.292308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f594a-7e5a-4fc2-9d0d-b90effc14a01 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.303740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0133430-46d6-455f-a700-3fe9a5323073 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.328459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.329119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.329337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.329693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.330532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=f1157b842770470fb1bc61297ae0e2c3) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.330826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.332363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.334367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.343527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 270/536] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/role_assignments?user.id=f1157b842770470fb1bc61297ae0e2c3&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.343527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.354162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.355458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.356205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.356960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.358026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.358940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.360899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.392863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 267/537] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.403008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.540051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95f94-4e20-40bd-9a21-3518d3a0fff8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.553529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:48.579510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9bd8d-e8d3-4ef8-843c-1977277b9d75 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.622802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.623946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.628580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.629086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.630028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=cf3acf73742b49409bfc4128386a3302) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.630745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.631843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.632513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.632787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.633053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.633262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.640148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 268/538] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/role_assignments?user.id=cf3acf73742b49409bfc4128386a3302&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.657412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.658911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f0c7160b-2055-475e-bf24-bec194f5d259 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:48.678554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:48.679542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:48.680421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:48.684466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 271/539] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:48.685862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.813461 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeb635-2237-485c-b480-7c2ddc27377d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:48.836086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d794e4-800b-4925-9c48-1c805371fe2d None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.836304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d794e4-800b-4925-9c48-1c805371fe2d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.836561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d794e4-800b-4925-9c48-1c805371fe2d None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.838024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 272/540] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:48.843911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.844191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.844490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.856361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:48.857342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:48.857948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:48.858860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:48.860021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:48.860612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:48.862245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:48.863898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:48.865973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:48.878879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 269/541] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:48.887743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:48.902450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.005682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33cda-edb6-4f1d-b250-935e54f256e9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.013012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.051439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.052429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.052920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 273/542] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:49.053377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.053809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.054782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=9f2b2a5d05b545b28da423e872f47a10) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.055256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.056944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.063682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 270/543] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:48 2022] GET /identity/v3/role_assignments?user.id=9f2b2a5d05b545b28da423e872f47a10&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:49.108466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.226121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1493-8cf9-47ed-a869-e257830bfa9b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.268096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbf917-58c0-4a03-b62c-6d51be690a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.269095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf917-58c0-4a03-b62c-6d51be690a95 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.269549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf917-58c0-4a03-b62c-6d51be690a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.270004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbf917-58c0-4a03-b62c-6d51be690a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.286362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbf917-58c0-4a03-b62c-6d51be690a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-48dbf917-58c0-4a03-b62c-6d51be690a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:49.291816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:49.292752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:49.293542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 274/544] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:49.299357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.380575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41165df-e607-4eb4-93e0-9e856c2997c1 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.381076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41165df-e607-4eb4-93e0-9e856c2997c1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.381076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41165df-e607-4eb4-93e0-9e856c2997c1 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.382746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 275/545] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:49.387912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.388198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.388476 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.393329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.420305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:49.421533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:49.459930 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a353a2-4456-45e7-a620-dcc3796927f8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.503017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.516966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.517881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.518344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.518798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.519671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:49.520157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.522048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.532355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 271/546] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:49.540894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.569316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 276/547] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:09:49.609697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.671870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436094df-acf3-4ee6-8590-28df8ebb637f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.704104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.720771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.721413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.721686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.721951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.747464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:49.748978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:49.781367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:49.782317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:49.783160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:49.783160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:49.783160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:49.783160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 272/548] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:49.801455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.807824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a420a7-92be-4aba-9d01-dcefa7eb079b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:49.851010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:49.851673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:49.851955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:49.852218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:49.876123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:49.883371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:49.884275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:49.885672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 277/549] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:49.896405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:49.937649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:49.991682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab78a93-9b85-4ee4-9c0e-b5c8e9ca63b7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.039936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.041569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.042040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.044185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.044710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.046442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.055491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd732ff-4d2c-45b1-b34d-8f94ebf0c4b4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.069831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 273/550] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:50.076604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.119538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.120130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.120418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.120692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.121457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.121758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.123216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.137794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.146563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 278/551] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:50.152884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.193879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d15a98-324e-4546-b230-af4ca617b879 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.234182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.235257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.235725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.236236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.245527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.247254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:50.259452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:50.260509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:50.261552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:50.264046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 274/552] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:50.269711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.316760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.321529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fc716-31c4-4264-996b-5bd6248447e5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.367985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.368657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.368931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.369193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.379081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30621b-ddbc-4782-84d7-5f5de51bb557 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.382637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.397543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.399654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.425390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.426764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.427467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.428042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.429121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.429653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.431363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:50.441889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:50.442963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:50.443979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:50.443979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:50.443979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:50.443979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 279/553] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:50.449839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.453723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 275/554] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:50.458899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.580937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019be72-f349-408b-9e46-121f961a4171 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.634961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cabdd-e896-4867-a709-1d1922996af3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.637012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.637928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.638398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.638869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.700538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.709263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.710216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.710688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.711149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.711989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:50.717328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.718961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.739096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 280/555] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:50.753447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.763972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.765856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:50.794151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.873944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 276/556] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:50.880627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:50.942473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4b1b-f3c3-48c6-955a-40fd53df5558 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.966222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:50.978572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:50.979208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:50.979480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:50.979743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:50.987453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:50.987943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752c3a6-c5fd-48b4-9903-c7b4751a630f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:50.988958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f3553de5-90de-4563-bfad-87e9990dafc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:51.001839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.003254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:51.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 281/557] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.004823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a315-3cdc-4145-93a0-c1a87f330b74 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.004823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a315-3cdc-4145-93a0-c1a87f330b74 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.004823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a315-3cdc-4145-93a0-c1a87f330b74 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.010288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 282/558] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:51.010288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3932d-d5e7-4279-81d7-8a4e34d081a1 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.010288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3932d-d5e7-4279-81d7-8a4e34d081a1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.010288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3932d-d5e7-4279-81d7-8a4e34d081a1 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.010288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 283/559] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:51.010677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3932d-d5e7-4279-81d7-8a4e34d081a1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.036586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.037356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.037635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.037903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.048114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.049578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-6b72f2d5-1360-4bed-8e44-92fb5b2799f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:51.064751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 277/560] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21482e-75de-4a9b-95da-eb276c3166a7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21482e-75de-4a9b-95da-eb276c3166a7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.072777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21482e-75de-4a9b-95da-eb276c3166a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.086981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7a21482e-75de-4a9b-95da-eb276c3166a7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:51.088156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7a21482e-75de-4a9b-95da-eb276c3166a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:51.091328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.124113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3932d-d5e7-4279-81d7-8a4e34d081a1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.160746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.161686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.162195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 278/561] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:51.163509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.163793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.164057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.164557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.165068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.166020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.166664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.168657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.183979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:51.185188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:51.190120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 284/562] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.190949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.230231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.257509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 279/563] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:51.258410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.307770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ecea6-1f69-4ade-b81f-124cff04726e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.338040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.345116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.345725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.345994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.346259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.346891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.347183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.348556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.360690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 285/564] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.361496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.370802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f02da-4675-49f9-b490-0fdcc886a33d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.406857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.407489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.407765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.408034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.418732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:51.423554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.424718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 280/565] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.426173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.466206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.481959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68503f07-3d47-4de1-ac78-5586eac362fa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.517534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.518166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.518441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.518707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.529855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.531086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348774-48d6-49ed-8a8a-17dbcada717a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.531295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:51.545578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.546707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:51.547790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:51.547790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:51.547790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:51.547790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 286/566] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.547790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.570102 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.570860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.571142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.571409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.581564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:51.588334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.589576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:51.590619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 281/567] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.591320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.593897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.653516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16a25-c89a-4bbb-93d0-f2d0b3423212 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.686529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.686993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.687633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.687963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.688224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.693915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ef3a7-a371-416c-b32f-792e6bbfe952 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.695261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.696749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ee2e4943-0e60-4285-a4d5-c79a4fd3af00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:51.708019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:51.709441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:51.710335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 287/568] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:51.710814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53630-7ed7-4cb4-be42-11e95c98513e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.711086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53630-7ed7-4cb4-be42-11e95c98513e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.711353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53630-7ed7-4cb4-be42-11e95c98513e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.716509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 288/569] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:51.717267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53630-7ed7-4cb4-be42-11e95c98513e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.730613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.731229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.731505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.731775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.732509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.732760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.734109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.742101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 282/570] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.742883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.823998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53630-7ed7-4cb4-be42-11e95c98513e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.825541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.839982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5d452-ea12-4407-9a98-6124a00d1fc8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:51.860368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.860993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.861285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.861551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.862189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.862489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.863862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.872908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:51.873518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.873791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.874056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.874713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:51.875012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:51.875458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 289/571] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.876240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.876465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff79ad-aac2-44bb-8e01-52d523d2e3a9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:51.888424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 283/572] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:51.889671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:51.889955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:51.890227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:51.909631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:51.910839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:51.929459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:51.983906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 284/573] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:51.985032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:51.987518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbed4e-a33b-4375-be61-0045c3a5c810 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.024414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.025048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.025312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.025577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.026256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.026553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.027968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.039001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 290/574] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.039788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.063697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.093833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eae385-f6ac-46cc-8019-32b8cc1cdc99 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.127330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.127968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.128244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.128540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.137919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269037a9-206d-4197-abdf-c7a79589cb2a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.138392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.139844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.148359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:52.155124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.156223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:52.157196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:52.157196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:52.157196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:52.157196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 285/575] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:52.157614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.171958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.172618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.172897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.173167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.179754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.181222 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:52.191997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.193107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 291/576] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:52.194326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.259744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b7581-8804-4e17-b191-e669ee8e7714 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.273583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.292028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748cf4-f834-48ef-9327-e5b2faa3e3a4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.294143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.294766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.295052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.295315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.305567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.307012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:52.320944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.322002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:52.322911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:52.322911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:52.322911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:52.322911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 286/577] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:52.323148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.327885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.328542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.328816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.329080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.339434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:52.344490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.345668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:52.346518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 292/578] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:52.347220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.376626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.421205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc97b5-7118-4ef7-9edc-c3f0a6ade60f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.442723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac3910-f31a-4550-9edf-96bff1ce0b88 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.455199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.455884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.456161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.456421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.457163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.457466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.458958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.464394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 287/579] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/role_assignments?user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.465159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.475824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.476598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.476942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.477278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.478005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.478313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.479744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.494911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 293/580] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.496798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.500560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.587224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5fb0e-3a9d-4637-9faa-26826366ef64 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.606159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.626650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.627923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.627923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.627923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.628479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.628776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.630812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.633145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89d88-541a-4782-97e3-5986614f5ba2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.643310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 288/581] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.644438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.677973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.678576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.678846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.679106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.679738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.680031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.681413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.693302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 294/582] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.694107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.754814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.766004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76ea33-d01d-4357-9359-e1eadfe3186a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.799773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.800502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.800698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599f2b4-9d16-44e7-896b-08754e3f51b4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.800897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.801224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.802004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:52.802379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.803824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.816752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 289/583] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:52.817710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.836703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.837548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.837845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.838169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.846474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.847967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.857703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:52.861099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:52.862229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:52.863380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:52.864369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 295/584] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:52.865288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:52.933095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3803f-19e5-4fff-874d-eb1b5d924798 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.969939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903a4fc-bcf3-4a8c-8b86-9c58606802cc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:52.970928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:52.971811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:52.972967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:52.973304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/2d6406240f104443b75c8ec7d7999070/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:52.988459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=2d6406240f104443b75c8ec7d7999070, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:52.990811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:52.993230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.007230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.007587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 290/585] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:52 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/2d6406240f104443b75c8ec7d7999070/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:53.008297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.013199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.013553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.013746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.027517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.029759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:53.047127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.048142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:53.049111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:53.051828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 296/586] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.053117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.130706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.146921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cbfd3-90b3-46de-9b18-34ae30531067 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.191710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.192394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.194114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.194114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.195967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087b205-43c8-4151-a3d6-40f9301ae321 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.206278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.208146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:53.228520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.229524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:53.231478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:53.231478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.231478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:53.231478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 291/587] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.231478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.240772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.241444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.241725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.242010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.242839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.243146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.244826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.264343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 297/588] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.265724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.320493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.350193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3ebfe-8733-49e2-964a-88d780c611e1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.387616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efbafc-9e99-4a07-9c32-b7744af510d6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.391979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083854b-335a-41c6-a730-74006635772e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.392957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083854b-335a-41c6-a730-74006635772e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.393399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083854b-335a-41c6-a730-74006635772e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.393808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083854b-335a-41c6-a730-74006635772e None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.394681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083854b-335a-41c6-a730-74006635772e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.395128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083854b-335a-41c6-a730-74006635772e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.396886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083854b-335a-41c6-a730-74006635772e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.407353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.418119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 292/589] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.419432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083854b-335a-41c6-a730-74006635772e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.426042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.426651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.427014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.427401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.428363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.428708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.430540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.450249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 298/590] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.450249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.533682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083854b-335a-41c6-a730-74006635772e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.564524 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.569399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26288765-2b7d-44c6-9f91-e529493d0785 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.576972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.577624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.577898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.578158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.592920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.594539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:53.610895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.612781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:53.614598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:53.614598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.614598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:53.614598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 293/591] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.614598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.627767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.628780 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.629203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.629633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.641921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.643601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:53.660229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.662083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:53.663957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:53.663957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:53.663957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:53.666531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 299/592] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.668135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.680797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.738943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898c617-bc04-4dee-8e65-b055ec50b19a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.776593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b54564-a094-419b-b0a5-03469508bdcf None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.781196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.781932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.782297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.782653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.792034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.794323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:53.808762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:53.809903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:09:53.811109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:53.817582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 294/593] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:53.817582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.822344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.823081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.823448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.823804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.824571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.824962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.826403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:53.847622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 300/594] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:53.847622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:53.859271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.938507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58279f9e-7377-49e9-90af-d0f0f21b5500 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.970898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4327-a20b-40ea-bacd-d303236e5157 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:53.972766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:53.980301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:53.981165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:53.981984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:53.982313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:53.983063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:53.983424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:53.985390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.002026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 295/595] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:54.003632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.012169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.013115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.013595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.014046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.015022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:54.015866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.017519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.037064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 301/596] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Aug 9 12:09:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:54.038110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.110994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.135196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b4175-c41e-4478-ab6c-c3243574734b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.146361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e11f6-69a3-4695-b4f9-e204cb21985e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.183629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.184555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.184922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.185280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.185526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.186311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.186729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.187154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.194474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.195066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.196101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.196923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:54.208815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:54.209881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:54.210996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:54.211524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:54.212746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:54.213848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:54.219546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 296/597] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:54.219546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.220582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 302/598] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:54.221605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.253688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.327759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128374-b686-4a54-b2f2-1bbae2a5167b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.353139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89667114-cb74-4bd9-a82f-d8366a36f970 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.371531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.372898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.373372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.373897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.384258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.389837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.392025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.392318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.392689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.392966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.393235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.393932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:54.394292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.395920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:54.410127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:54.411101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:54.412040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:54.412040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:54.412040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:54.412674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 303/599] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:54.413500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.414466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 297/600] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:54.415517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.518065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.518272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b2c68-3cf3-4934-abee-3a870967f64a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.539701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55fbd1-8762-4b79-bf6a-c1051e354c88 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.557441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.558123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.558327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.558593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.559278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:54.559579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.561054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.578321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 304/601] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:54.578321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.582512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5e71a-b8bb-4251-9990-3642059376a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.583219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5e71a-b8bb-4251-9990-3642059376a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.583478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5e71a-b8bb-4251-9990-3642059376a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.583758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5e71a-b8bb-4251-9990-3642059376a4 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/cf3acf73742b49409bfc4128386a3302/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.600818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5e71a-b8bb-4251-9990-3642059376a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=cf3acf73742b49409bfc4128386a3302, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.602732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5e71a-b8bb-4251-9990-3642059376a4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.619369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 298/602] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:54 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/cf3acf73742b49409bfc4128386a3302/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:09:54.625876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb213-bd01-4201-8f07-4772bdd1ce57 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.626186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb213-bd01-4201-8f07-4772bdd1ce57 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.626413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eb213-bd01-4201-8f07-4772bdd1ce57 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.632325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 299/603] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:54.632325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eb213-bd01-4201-8f07-4772bdd1ce57 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.649197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.718099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20075d2a-4928-44dc-b039-6f7acc8a8df9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.752912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eb213-bd01-4201-8f07-4772bdd1ce57 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.756194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.757054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.757514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.757924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.758729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:54.759176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.760740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8374a75-f943-48b8-a3ab-c0e68104ac39 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.774235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 305/604] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:54.775736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.776172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.776627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.793758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:54.795833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:54.797170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:54.798704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:54.799711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:54.800313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:54.800921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/f1157b842770470fb1bc61297ae0e2c3/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:54.821140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=f1157b842770470fb1bc61297ae0e2c3, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:54.822735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:54.841974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 300/605] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:54 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/f1157b842770470fb1bc61297ae0e2c3/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:54.842829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.879216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 306/606] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:54.902382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:54.978627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239d9b1-3c77-4af9-adae-2aa2b1eb5915 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:54.998957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.023242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.024347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.024679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.025034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.033428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.035211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:55.049984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.051024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:55.052192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:55.054469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 301/607] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.059278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.110703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e871e6-ed7d-443b-b285-56953bee95e7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.112686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.157487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05633d-a0d7-41f7-99b0-515673984898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.158672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05633d-a0d7-41f7-99b0-515673984898 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.159089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05633d-a0d7-41f7-99b0-515673984898 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.159644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05633d-a0d7-41f7-99b0-515673984898 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.173821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05633d-a0d7-41f7-99b0-515673984898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:55.179394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c139f-b859-4f79-9989-fbb1af2e5090 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-df05633d-a0d7-41f7-99b0-515673984898 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:55.179981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.181075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:55.182154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:55.189522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 307/608] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:09:55.190227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006058-5475-462e-8e2d-f82cb378d13b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.190459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006058-5475-462e-8e2d-f82cb378d13b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.190727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006058-5475-462e-8e2d-f82cb378d13b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.193088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 308/609] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:55.193902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8006058-5475-462e-8e2d-f82cb378d13b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.233229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.234507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.235911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.236411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.237338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.237840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.239630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe05c2-db3c-4e6c-8e3b-bce361e99325 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.256729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 302/610] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.258415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.258894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.259359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.284702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:55.286977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:55.310494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8006058-5475-462e-8e2d-f82cb378d13b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.320749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.349464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.350395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.350675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.350947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.352017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.352373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.353872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.370138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 309/611] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.370138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.381044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 303/612] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:55.383596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.443570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.484602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd2c05-c7cc-4402-a82f-38b7ca52898a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.496353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250cf07-8b24-4bd8-b441-66e48ece3d62 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.520531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.521434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.521848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.522253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/9f2b2a5d05b545b28da423e872f47a10/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.533267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.534046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.534420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.534848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.538409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=9f2b2a5d05b545b28da423e872f47a10, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.540076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.545979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.547638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.556357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 310/613] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:55 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/9f2b2a5d05b545b28da423e872f47a10/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:55.557596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:55.572223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.573425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:55.574543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:55.574543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:55.574543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:55.580450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 304/614] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.580823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.585417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.682174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7ace-d412-4813-a01e-286e2a36aca6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.728941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.729879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.730291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.730718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.748313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.757111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:55.762960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:55.764117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:55.765109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:55.775848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 311/615] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:55.781763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.786426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163069b-0a31-4af9-aa38-a9c686fe98bc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:55.855374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:55.856166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:55.856573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:55.856957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:55.857708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:55.858266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:55.860103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:55.874629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 305/616] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:55.876295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:55.880896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:55.947824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa33e15-03de-4782-9a5b-cabee06c46cc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.009456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.010106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.010383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.010645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.011368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.011668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.013042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.036419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 312/617] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.036419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.049509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c55ce-cd13-4f40-8fec-cfe204f99950 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.088011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.089713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.090358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.091862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.104506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.110669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:56.128853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.129951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:09:56.131162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:56.142871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 306/618] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:09:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.149839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.159572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.197329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a1769-f3a4-4d40-8d60-f0b803e2c492 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.252720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.254039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.254308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.254571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.258537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.275855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.277332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:56.302792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.303782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:56.304732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:56.304732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:56.304732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:56.310201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 313/619] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.316733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.331109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9858ee-ee76-42b2-81ed-1666d65498b2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.367802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.368955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.369239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.369503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.370234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.370531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.372121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.399817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 307/620] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.405534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.474441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d0561b-4198-45f5-bca1-4de8b7f798e9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.524852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.539245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.539858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.540129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.540407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.541058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.541356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.542715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.569257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 314/621] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:56.574115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.597319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bb591-3707-4e59-9bf5-fbc0de21e34f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.670501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.671559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.672058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.672556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.672763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.695767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.697272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.720584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca28994-de12-465f-a888-cbee6ecb1959 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:56.726509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.727633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:56.728720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:56.728720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:56.728720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:56.738137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 308/622] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.743460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.756663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.757603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.757937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.758262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.766523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.770289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:56.780559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:56.781764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:09:56.782935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:56.784947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 315/623] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:56.794981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.905100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd206f-6d3b-434e-b48c-86c4a8b5422c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.912316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.914875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b913acf-5d59-4e7f-a613-4d079593dbd5 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:56.939732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.940474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.940636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.940898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.941643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.941911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.942602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:56.943636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73e01a-eb4c-4037-9698-153e4cdc107b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.957451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:56.958660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.959196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.959737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.960634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:56.961875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:56.962274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 316/624] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.963652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807958-58c7-4d99-ab42-651400545fc0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.963929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bc2a0-f0b0-455b-9cc6-49781c5ff012 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:56.964042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807958-58c7-4d99-ab42-651400545fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.964341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5807958-58c7-4d99-ab42-651400545fc0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:56.969720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 317/625] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:56.969720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807958-58c7-4d99-ab42-651400545fc0 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:56.982763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 309/626] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:56.984525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:56.985016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:56.985458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.004946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:57.006679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:57.076164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5807958-58c7-4d99-ab42-651400545fc0 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.091348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 310/627] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:57.092531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.112045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071be8a6-801f-41ca-bc1b-2668293b1103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.112764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be8a6-801f-41ca-bc1b-2668293b1103 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.113080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be8a6-801f-41ca-bc1b-2668293b1103 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.113426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071be8a6-801f-41ca-bc1b-2668293b1103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.147486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.187665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be8a6-801f-41ca-bc1b-2668293b1103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.189297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071be8a6-801f-41ca-bc1b-2668293b1103 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.218431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a4136-9c4b-469c-ae75-91a74aad270c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.221033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.253028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.253949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.254373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.254634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.261347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.262771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:57.274343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.275322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 311/628] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:57.276201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.297159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 318/629] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:09:57.298693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf82f-e8bf-4159-99f7-f0595ab92bfa None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.298974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf82f-e8bf-4159-99f7-f0595ab92bfa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.299240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bf82f-e8bf-4159-99f7-f0595ab92bfa None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.304432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 319/630] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:57.304432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bf82f-e8bf-4159-99f7-f0595ab92bfa None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.366862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.396073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b5fb2-ed9e-40c9-ae03-8b12fbe7712d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.413688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bf82f-e8bf-4159-99f7-f0595ab92bfa None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.431628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.432256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.432551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.432818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.443908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:57.447057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.447660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.447931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.448195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.448905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:57.449205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:57.449887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.450790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:57.451634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:57.452286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e8ce7-1256-4925-bada-865561dcf36b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.456175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 312/631] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:57.456881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.469271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 320/632] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:57.469271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.469271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.469271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.484011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:57.485218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:57.487959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.551879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 321/633] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:57.553463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.571819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823eb16-01c5-4c60-9f49-b6cb2bbe455a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.607943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.608619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.608888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.609148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.612763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.621920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.623366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:57.637745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.638694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:57.639577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:57.639577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:57.639577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:57.639577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 313/634] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:57.639577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.664919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65f79f-863c-43d3-bc2d-d14afc2df493 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.703992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.704672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.704893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.705151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.705799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:57.706096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.707462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.716136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 322/635] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:57.717111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.729126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.754667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce0c1b-50fb-43a0-a9ba-b7ef6a06b932 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.798342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.798998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.799271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.799538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/f3b5cb27f7e64ea1b3a04dc71d1d36aa/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.815548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=f3b5cb27f7e64ea1b3a04dc71d1d36aa, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:57.817030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:57.827649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fb16-2f51-45c9-86ba-5125f3b11c68 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:57.831832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 314/636] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:09:57 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/f3b5cb27f7e64ea1b3a04dc71d1d36aa/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:09:57.832746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.852667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:57.873126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:57.873937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:57.874312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:57.874579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:57.888735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:57.894645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:57.895787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:57.897208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:57.901119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 323/637] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:57.902173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:57.964934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e06d0-f8e2-4a33-8004-067f47ae5913 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.002316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.014774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.015701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.016007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.016274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.016947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.017255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.018641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.023345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71c510-a22f-4637-8a89-70c80b715648 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.036686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 315/638] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.037576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.064038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.064715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.064993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.065265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.077308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.078768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-cc09868b-8565-4c1d-a0b7-b6facb97d2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:58.094688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:58.095746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:58.096681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:58.096681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:58.096681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:58.096681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 324/639] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:58.096919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a454-cde7-4649-a82f-fe12a9afa25f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.097389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a454-cde7-4649-a82f-fe12a9afa25f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.097485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77a454-cde7-4649-a82f-fe12a9afa25f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.098777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 325/640] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:09:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:09:58.099329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a454-cde7-4649-a82f-fe12a9afa25f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.135987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.153466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dc816-6731-4842-aa1c-53af1f40a54d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.192706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.193437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.193839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.194167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.195310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.195614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.197557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.213991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 316/641] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.213991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.214290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77a454-cde7-4649-a82f-fe12a9afa25f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.252113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.252828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.253115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.253383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.261358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.262424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.262939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-76e04fb4-34cd-496e-bf11-573235433159 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:09:58.275648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:58.276709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:58.277639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 326/642] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:58.278457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.279147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.279423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.297518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:09:58.298698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:09:58.322382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3a1c-3fa6-4246-bbc7-8886a608a7d2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.357642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.358251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.358526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.358796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.359430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.359807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.361129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.369644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 327/643] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:09:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:09:58.370730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.379348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 317/644] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.383961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.402312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.487912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9e719-05b7-4e29-88ac-849c0738fc1f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.488124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bffc75-544f-40bd-bf47-af2bed24b869 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.497569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.524716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.525270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.525540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.525803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.526485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.526699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.526824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.527327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.527600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.527867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.528172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.538275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.539702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.545711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 318/645] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.545711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:58.560232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:58.561284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:58.562365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:58.562365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:58.562365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:58.562365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 328/646] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:58.562365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.635423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.652226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d71c25-fa0a-434a-ad31-290b0e7ccf61 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.668174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319e155-9229-4457-9569-3a60198432e4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.686177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.686805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.687075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.687338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.694764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.696190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.702013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.702638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.702911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.703177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:58.707125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:58.708123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 319/647] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:58.709112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.718707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:09:58.723822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:58.725213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:09:58.726251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:58.728419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 329/648] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:58.728419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.748860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.825435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97334a7-ea35-4379-b631-52624cc44438 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.827073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9fa3f-7e3b-467a-98b6-5050cddcd9e0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:58.855684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:58.861103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.861346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:58.862228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.862459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:58.862727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.863202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:58.863421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.863522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:58.864054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.864259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=2d6406240f104443b75c8ec7d7999070) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:58.864502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.864599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:58.865880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.866004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:58.876411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 320/649] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/role_assignments?user.id=2d6406240f104443b75c8ec7d7999070&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.876411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:58.880907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 330/650] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:58.880907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.004158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.016676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db41c16-8ed1-433d-bcf0-32abb94b50a5 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.017588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fab75b-6b46-4e58-8728-7e19d0007bcc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.060640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.061256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.061530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.061801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.062539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:59.062841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.064891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.068714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.069344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.069622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.069892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.070560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:59.070861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.072235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.081448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 331/651] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:59.082213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.088828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 321/652] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:59.089823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.145781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.210048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96417f40-19c0-4329-b296-052545c6f44f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.214859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763c1a9-4615-442f-9059-3984e2342bba None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.252634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.253267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.253544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.253810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.257920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.258691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.259130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.259527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.263192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.264682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:09:59.277080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:59.278293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 332/653] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:59.279435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.285974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.354696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.356397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.392830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9103f1-dab9-41c6-9796-e3eb96085a8e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.410468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.442883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.444426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.444844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.445295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.461139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.463473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.469926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 322/654] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 12:09:59.470992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:59.481477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:59.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:59.483723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:59.483723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:59.483723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:59.490711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 333/655] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:59.490711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.532036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.606484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960c95a-15aa-4ad5-b86b-0f8ae65224ea None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.612459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568a33e-7fe4-400d-bb33-1cd18c970cea None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.648145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.649166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.649627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.649977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.654508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.655628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.656038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.656482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.657349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:59.657806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.660366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.662150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.663730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:09:59.679309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:09:59.680515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:09:59.681622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:09:59.681622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:09:59.681622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:09:59.683007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 334/656] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:09:59.683966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.685148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 323/657] 10.222.0.60 () {56 vars in 1137 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:59.692759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.709621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.797807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef19767-fb36-49c8-bd53-3cd29bda50d0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.826700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4487956-62b7-4348-bec0-6dca54192b11 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.837092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.843584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.844806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.845512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.845987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.847179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:59.847705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.849976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.863702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:09:59.864392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:09:59.864658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:09:59.864884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:09:59.865523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:09:59.866015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:09:59.867389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:09:59.868298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 335/658] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:09:59.869635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.880125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 324/659] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:09:59.883664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:09:59.959320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:09:59.983643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f579221-f97c-4708-a2e4-34665767ba94 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:09:59.996261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bebd3c-759c-4b04-83b0-b75617650572 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.017474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.018084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.018358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.018620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.032936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.033772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.034205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.034624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.042682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.044148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-798a1c1d-f610-460b-9afe-0514d8ac3d86 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:00.055123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.056067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 12:10:00.057359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:00.060886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 325/660] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:00.062115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d9c45-2279-4436-963f-e143c2b067dd None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.062394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d9c45-2279-4436-963f-e143c2b067dd None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.062662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d9c45-2279-4436-963f-e143c2b067dd None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.063895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 326/661] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:00.064636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d9c45-2279-4436-963f-e143c2b067dd None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.093167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.094026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.094975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.176473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d9c45-2279-4436-963f-e143c2b067dd None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.180540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.205072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 336/662] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:09:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:10:00.205914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.217689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.218482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.218848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.219209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.227594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.229076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-942b2567-b9ae-405f-9a76-6d1950687c4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:00.240805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.241792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:00.242724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 327/663] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:00.243682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.243682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.243968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.261837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:00.263030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:00.316350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f7cae-1799-4626-9b91-3e8eca722382 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.335976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 328/664] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:00.337657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.355040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.355649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.355922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.356188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.356996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.357297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.358772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.365545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.376730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 337/665] 10.222.0.60 () {56 vars in 1139 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:00.377731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.415776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.458378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac57dfc-c2fd-4bd6-8290-eabe62f090a5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.482891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4546-c2af-4e01-820f-f5eb623e5bc9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.493450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.494086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.494359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.494621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.505493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.506927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.519124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.519729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.520003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.520272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.521376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.521687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:00.522689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.523612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:00.524522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:00.524522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:00.524522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:00.524693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.528641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 329/666] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:00.529718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.543867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 338/667] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:00.543867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.604573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.637727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b8dcc-5496-4d0d-8255-672f9d966412 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.640021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.648499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a57a-ab52-4f03-9b25-5fb93b28a134 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.675190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.675901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.676186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.676474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.685588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.686467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.686957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.687270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.688040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:00.693155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:00.694092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:00.694975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:00.699224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 330/668] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:00.700080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.763375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.764864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.804718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c9a4-9cc2-4a80-b0ed-98d0db54d29a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.833670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.839921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:00.840945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:00.841546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:00.841895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:00.842672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:00.843089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:00.844587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:00.871753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 331/669] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:00.871753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.878598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:00.895362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 339/670] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:10:00.895362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:00.978220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c8bc9-b843-49a9-882c-5abb9bce232c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:00.993753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8630f-6813-49ab-bec1-02c9ac6bdd45 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.016779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.017318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.017589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.017851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.018684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=cf3acf73742b49409bfc4128386a3302) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.019081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.020604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.037051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 332/671] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/role_assignments?user.id=cf3acf73742b49409bfc4128386a3302&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.037051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.039806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.040521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.040796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.041057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.041758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.042056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.043457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.053806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 340/672] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:10:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.054776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.102350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.123621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.155089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8f069-805e-49ab-8af7-dc7216b00ebf None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.172026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcb8e-397c-4abb-abc0-e6c65a11aeef None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.193740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.194532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.195474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.195474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.204105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.205564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.209050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.209701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.209976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.210239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f270d942-360e-4ee5-8e2d-55974a9b6d26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:01.218619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.219743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:01.220803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 333/673] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.221398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe6e2-4567-4d4c-8a71-dea99aebcd4b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.221398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe6e2-4567-4d4c-8a71-dea99aebcd4b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.221550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe6e2-4567-4d4c-8a71-dea99aebcd4b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.224421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 334/674] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:01.224421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe6e2-4567-4d4c-8a71-dea99aebcd4b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.226809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.228624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:01.244506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.245754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:01.246817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:01.246817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:01.246817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:01.246817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 341/675] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.247100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.350056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe6e2-4567-4d4c-8a71-dea99aebcd4b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.357679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db56c0-d8f3-4564-b21b-7a753ab7f91a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.366526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.367010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.390171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.391249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.391593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.391857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.392892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.393498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.393773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.394044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.394727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.395042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.396691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f51b40-a77c-4c91-a98b-1cfa13801d73 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.405573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.407154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.413468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 342/676] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.413468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.413468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.413468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:01.428488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.429696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:01.430815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:01.430815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:01.430815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:01.431020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:01.431020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:01.438095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 335/677] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.438967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.510008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 343/678] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:01.510864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.554946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b94ea6-8cc3-4756-bbf4-c16de3d7423a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.589170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.589783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.590054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.590316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.590981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.591276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.592735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.605948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 336/679] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.606706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.625956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.630775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42fbf-8b00-49a1-ba76-1f788af4902c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.639916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.673401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.674006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.674279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.674545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.675264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=f1157b842770470fb1bc61297ae0e2c3) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.675566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.677813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.683850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 344/680] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/role_assignments?user.id=f1157b842770470fb1bc61297ae0e2c3&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.684726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.725557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cfb43-2b42-4fdc-a631-1377e034fc1e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.781211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.781847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.782189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.782457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.783201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:01.783459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.785098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.798987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 337/681] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:01.799653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.809314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f2d9d-a2a5-4315-b69f-b16404644817 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.849904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.851005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.851535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.852004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.864146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:01.869663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.870676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:01.871577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 345/682] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.872322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:01.897696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.902524 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:01.919923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af1a20-0290-4fd5-b305-8e662b350828 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:01.955581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:01.956213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:01.956578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:01.956850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:01.963719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:01.965331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:01.978263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:01.979298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 338/683] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:01.980210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.010958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff2fed-9392-4706-94bd-e6e890917ac5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.055952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.056861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.057145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.057413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.066342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.068468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:02.084182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:02.085461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 346/684] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:02.086662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.096428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d125673-f891-4d0e-8bf7-176ded31ab03 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.132841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304368-927a-4696-be63-05a17625b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.133487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304368-927a-4696-be63-05a17625b10f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.133821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304368-927a-4696-be63-05a17625b10f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.134154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304368-927a-4696-be63-05a17625b10f None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.134905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304368-927a-4696-be63-05a17625b10f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.135266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304368-927a-4696-be63-05a17625b10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.136738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01304368-927a-4696-be63-05a17625b10f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.146544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 339/685] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:02.147565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304368-927a-4696-be63-05a17625b10f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.159551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.192926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.220237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa21f-eaa1-42c1-ba92-94416ed84820 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.260996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.261943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.262354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.262774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.263612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.264157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.266181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.284957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01304368-927a-4696-be63-05a17625b10f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.285267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 347/686] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:02.286667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.320725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.321464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.321810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.322143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.323040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.323414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.325118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.348999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 340/687] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:02.348999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.396334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c7acf-750c-4579-9068-7a860d9e526e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.418056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.433695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.434545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.434986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.435471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.446385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.448049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.450166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.456192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2bc02-69d8-4cb7-b866-87ade0d97ab6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:02.465397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:02.466542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:02.467645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:02.467645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:02.467645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:02.473936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 348/688] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:02.475126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.495063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.495863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.496110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.496472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.497268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=9f2b2a5d05b545b28da423e872f47a10) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.497642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.499126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.512726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 341/689] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/role_assignments?user.id=9f2b2a5d05b545b28da423e872f47a10&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:02.512726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.620161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba1ffa-6e7f-4959-b5fd-fdb4ae16d8e6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.655351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.655535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b5437-87a6-4de7-b992-6e9ab8a4c3a7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.669282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.669910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.670180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.670441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.671098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:02.671393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.672802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.695938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 342/690] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:02.703848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.727373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.728981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.729472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.729933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.820705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:02.830866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.832881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.841122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014beec2-1ed5-4d18-a756-01a39fcf7468 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:02.904838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:02.905705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:02.906230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:02.906565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:02.917785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:02.919247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:02.936232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:02.937275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:02.938295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 343/691] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:02.944203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:02.967051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 349/692] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:10:02.972840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.044665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.103944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd4b4-5257-4741-8e6b-14a7667cd7c7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.157880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.171143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258a9cb8-f8bb-4310-8215-aca54be5f772 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.185604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.186481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.186912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.187335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.188219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:03.188703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.190309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.231116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.232070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.232517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.232963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.233303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 344/693] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:03.241386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.264510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.267104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6b73eea9-6bd3-428d-99f9-e6aa6f2013e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:03.294304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:03.295348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:03.296287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:03.296287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:03.296287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:03.298518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 350/694] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:03.300181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcda60-417c-468c-a234-97e5fb0dfcc4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.300916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcda60-417c-468c-a234-97e5fb0dfcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.301707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcda60-417c-468c-a234-97e5fb0dfcc4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.304103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 351/695] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:03.305129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcda60-417c-468c-a234-97e5fb0dfcc4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.346992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d488b-8655-49ef-a44a-2b95f4225cc8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.356685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.385272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.385878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.386150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.386415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.422233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcda60-417c-468c-a234-97e5fb0dfcc4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.460563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.461660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.462565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.463004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.463497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.464283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:03.464772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.466447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6519-5ac6-41f6-8c75-90c2d7a5a919 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.480882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 352/696] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:03.482602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.483100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.483512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.497735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.504879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:03.507541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:03.574362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 345/697] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:10:03.575662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.588747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.588948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 353/698] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:03.590515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.679917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81872b32-1f3d-417a-b074-0819e57c55d1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.719440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.720204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.720584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.720922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.726002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6b722-53a0-4571-8110-ea0e09e18c99 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.728256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.729840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:03.741639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:03.742583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:03.743458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 346/699] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:03.743941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.776996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.778209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.778662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.779302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.783624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.795337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.797665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:03.818510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:03.819534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:03.820448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:03.820448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:03.820448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:03.826715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 354/700] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:03.826715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.827347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:03.863944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0305e-d523-4794-826c-a45c2a5f2a88 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.909470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.910111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.910387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.910656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.921488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.922941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:03.938285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:03.939299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:03.940179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:03.940179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:03.940179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:03.940179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 347/701] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:03.940179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:03.958475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1f35b-8f1a-4159-bbf9-53c21d9ecc1f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:03.994745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:03.995396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:03.995646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:03.995916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:03.996591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:03.996896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:03.998321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd1cbd-a3c2-4c10-982d-465b808f1bb8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.010941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 355/702] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.012139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdadd7-171e-4e38-8e2e-c629f42b88cf None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.012447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdadd7-171e-4e38-8e2e-c629f42b88cf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.012718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdadd7-171e-4e38-8e2e-c629f42b88cf None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.014092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 356/703] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:04.014600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdadd7-171e-4e38-8e2e-c629f42b88cf None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.057903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf6300-974f-4544-a01c-1fa2303886c6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.069408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.081901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.101020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.101626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.101899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.102275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.102796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.103094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.104490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.120905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 348/704] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.120905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.127344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdadd7-171e-4e38-8e2e-c629f42b88cf None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.166130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.166886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.167164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.167711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.168345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.168672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.170425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89a4c1-fd8b-4a22-8378-81a3bc9f4b99 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.189333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 357/705] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.189333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.189333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.189333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.207270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:04.208758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:04.217665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d2704-2fae-4055-ad03-dad42ec3121f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.252870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.253440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.253740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.253973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.254802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.255134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.256713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.262724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 349/706] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/role_assignments?user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.263529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.284495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 358/707] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:04.286531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.328161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.346438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.393538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10662a43-ce5f-4802-9a66-48f7d2eadbd9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.433912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.434158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.434238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd1d73-c923-475f-8a94-48d176c5dd27 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.434327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.434598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.443109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.444974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:04.458779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:04.459725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:04.460714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:04.463131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 350/708] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:04.464268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.482988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.483922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.484346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.484815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.485449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.486884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.517323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 359/709] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:10:04 2022] POST /identity/v3/users => generated 254 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:04.518233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.608092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b56b33-75b3-4fa3-826c-0b5cacde76aa None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.611757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.657553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.658754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.659028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.659443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.660045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.661945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.666715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:04.677450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:04.678596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:04.679454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:04.680213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 351/710] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:04.682324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12f1ac-c803-41be-bf37-c64a88a6bf4e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.691497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.738349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.738884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.739267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.739539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.740238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.740589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.742555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.756982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 360/711] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.763575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.817877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236a006-ef3f-4ef5-815b-c9bd3abd31a8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.867335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.868138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.868474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.868747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.869387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.869688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.871089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.889002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 352/712] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.891942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:04.904899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116174e3-8d3a-4705-aaf5-dfa828b6168f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:04.925749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:04.947686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:04.948489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.948667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.949034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.949644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=2d6406240f104443b75c8ec7d7999070) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:04.949950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:04.951411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb5db1-ffc0-4428-91d0-86df0565c43e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:04.960550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 361/713] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/role_assignments?user.id=2d6406240f104443b75c8ec7d7999070&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:04.960550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddb85c-cfa1-42b9-a2e2-16312849bfd6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.960550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddb85c-cfa1-42b9-a2e2-16312849bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.960550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddb85c-cfa1-42b9-a2e2-16312849bfd6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.961878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 362/714] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:04.968578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:04.968908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:04.969127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:04.990104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:04.991353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:05.009874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.100258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 363/715] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 12:10:05.128813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.248507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50c64f-3ad0-4839-b139-b98d071bda3f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.287010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bfe54-115d-4344-abdf-e1a174d2e610 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.323626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.324266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.324564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.324831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] PATH_INFO: `/v3/services/network` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.325407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.326775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:05.338288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:05.339362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:05.340234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:05.344632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 364/716] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:05.345484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.361549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.367015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.367642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.367907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.368165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.368830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:05.369141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.370499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.394373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 353/717] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 9 12:10:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:05.548349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d624c5-6c17-4e8b-b264-22b98e0e0f75 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.613247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.613869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.614192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.614464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.615100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] RBAC: Adding query filter params (name=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:05.615395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.616813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447080a7-9101-4ce1-926f-68fb89079e33 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.621915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 365/718] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:05.629700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:05.792795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:05.803077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0c6f-bfd4-451e-b0bd-e132308a6cb9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:05.914601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:05.914601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:05.914601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:05.914601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:05.915427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:05.915427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:05.917938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814209c-8143-451d-856e-8470ae72a2b9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:05.927352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 354/719] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:06.932030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc193c-b90f-458b-9490-2fa6531bf194 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.932609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc193c-b90f-458b-9490-2fa6531bf194 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.932609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc193c-b90f-458b-9490-2fa6531bf194 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.934223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 366/720] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:06.939485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:06.939894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:06.940096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:06.958399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:06.959608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:07.026721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 355/721] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:07.068805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc193c-b90f-458b-9490-2fa6531bf194 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.166725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.190911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc193c-b90f-458b-9490-2fa6531bf194 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.225088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91c48f-1e50-421a-8b6c-bbae6bd44053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.225757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91c48f-1e50-421a-8b6c-bbae6bd44053 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.226035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91c48f-1e50-421a-8b6c-bbae6bd44053 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.226297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91c48f-1e50-421a-8b6c-bbae6bd44053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.236688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91c48f-1e50-421a-8b6c-bbae6bd44053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-cd91c48f-1e50-421a-8b6c-bbae6bd44053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:07.241981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:07.242960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:07.243835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 367/722] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:07.249303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.327103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90870758-b63f-4e5b-9ed0-5d5fc51f63c8 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.327376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90870758-b63f-4e5b-9ed0-5d5fc51f63c8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.327648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90870758-b63f-4e5b-9ed0-5d5fc51f63c8 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.329075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 368/723] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:07.334084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35229-a0b5-4963-9408-2f2ec095cbf4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.334360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35229-a0b5-4963-9408-2f2ec095cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.334629 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35229-a0b5-4963-9408-2f2ec095cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.361805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-41b35229-a0b5-4963-9408-2f2ec095cbf4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:07.362985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-41b35229-a0b5-4963-9408-2f2ec095cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:07.372741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.385049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da670-5799-4b6f-9f81-47e9a6fab2dc None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.445205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.445727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.445999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.446262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.446922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:07.447214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.448604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c56ac-c0f4-4754-a50a-be989ffc4cb9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.457467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 356/724] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:07.458945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7ddfb-718c-4499-8d1b-daa3d56e2c6e None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.459226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7ddfb-718c-4499-8d1b-daa3d56e2c6e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.459510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7ddfb-718c-4499-8d1b-daa3d56e2c6e None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.464414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 357/725] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:07.464414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7ddfb-718c-4499-8d1b-daa3d56e2c6e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.480827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 369/726] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:07.483123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.483563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.484007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.508783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:07.510283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:07.581333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.589722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 370/727] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:07.590580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.602352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7ddfb-718c-4499-8d1b-daa3d56e2c6e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.651423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.652397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.652875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.653642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.667418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.670154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:07.688972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:07.689995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:07.691352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:07.691352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:07.691352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:07.691352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 358/728] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:07.691666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.695926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.727860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d77c-306f-4f33-b725-e09e809baae1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.770550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.771726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.772197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.773138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.786104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:07.792664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:07.793567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:07.794404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:07.797573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 371/729] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:07.799022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.801558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb1297-119d-49dc-9a3a-763695feb051 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.840937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.841573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.841848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.842110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.853045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:07.858228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:07.859144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:07.859982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:07.864341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 359/730] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:07.865253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:07.871396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.922697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59dda3-d8fc-4bac-b06c-7b57f49b77fb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:07.947567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:07.958705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:07.959302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:07.959573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:07.959836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:07.960507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:07.960801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:07.962170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:07.973950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 372/731] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:07.974746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.000528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee911a1-ef9b-4ae4-a7c6-0adcbd54a927 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.034626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.035333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.035611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.035884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.036578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:08.036877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.038246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c94d5-f53d-4d8b-a137-044fb0d82cdf None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.051028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 360/732] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:08.052333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a64a93-17ab-47ed-8584-0ba2387ffea4 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.052637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a64a93-17ab-47ed-8584-0ba2387ffea4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.052907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a64a93-17ab-47ed-8584-0ba2387ffea4 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.054168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 361/733] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:08.054852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a64a93-17ab-47ed-8584-0ba2387ffea4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.080061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204b566-1e5c-4a4d-845b-a0ac2b9729ed None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.098084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.117627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.118331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.118664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.119048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.119703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:08.120001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.121426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.134526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 373/734] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:10:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:08.134526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.161940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a64a93-17ab-47ed-8584-0ba2387ffea4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.186615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.195992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.196654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.196940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.197202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.204899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.206267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-66e4d3b2-ac89-45d2-881b-3d687390b29d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:08.217832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:08.218826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:08.219765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 362/735] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:08.220771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.220771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.220771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.238015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:08.239345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:08.244515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2eb02-0c3b-4e54-90b9-e7c21434c3a7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.281076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.282117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.282485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.282713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.293791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.295515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.316400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 363/736] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:08.316400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:08.316677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:08.318142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:08.319258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:08.319258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:08.319258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:08.319258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 374/737] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:08.319258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.351736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.416411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d048450-f711-4848-9dd4-8365cd853661 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.424621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54762611-bc4f-4df3-a36c-7f8e46d413f6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.433564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.451682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.452368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.452669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.452937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.460528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.461073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.461332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.461592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.462315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:08.462616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.463992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.464096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.465453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:08.480775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:08.481744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:08.483123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:08.483123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:08.483123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:08.483321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 375/738] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:08.483321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.489114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 364/739] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:08.489114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.573249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.584730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad538c25-bdf0-4d02-b390-91f75c9bd01a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.585832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24305-86b7-4d52-93be-d8c130c73cd6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.619997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.620637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.620907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.621090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.621226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.621701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.621797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.621973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.622242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.622886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:08.623134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.623227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.624573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.637826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 376/740] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:08.638641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.648438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 365/741] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:08 2022] POST /identity/v3/services => generated 251 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:08.648438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.676577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.761825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cb9c2-4b4f-4154-95eb-aca77d7dfd65 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.770591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e273d-3073-483d-9970-2fad5af5a0e3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:08.805432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.806044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.806316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.806581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.806818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:08.807427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.807705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.807972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.808634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:08.808936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.810519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9819c9a-012a-472b-9640-58081c3f23b6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.902660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:08.904204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:08.932656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:08.950548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 377/742] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:08.950548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6913e-230b-4fca-884a-33d68a32fafb None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:08.950548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6913e-230b-4fca-884a-33d68a32fafb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:08.950548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6913e-230b-4fca-884a-33d68a32fafb None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:08.950548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 378/743] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:08.950548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6913e-230b-4fca-884a-33d68a32fafb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:08.963915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.018677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 366/744] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 12:10:09.018677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.066881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6913e-230b-4fca-884a-33d68a32fafb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.101263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.101889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.102161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.102423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.109689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.111146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-276f86dd-949c-4846-a4a4-592af54ad662 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:09.122586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.123560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:09.124595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 379/745] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:09.125228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.125557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.125654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.139198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ef9e9-58be-4143-8595-9508c07f7ba8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.143470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:09.144732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:09.164484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.175430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.176069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.176343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.177627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.185098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.186569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:09.199009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.200067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 367/746] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:09.201491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.223563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.230002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 380/747] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 12:10:09.230821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.333351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2e7f4-3dd3-4040-a57a-2d0cc130dd74 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.352271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467edcb6-2c40-47a3-8789-d4e42a02a538 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.369507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.370139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.370408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.370675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.382053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.383492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.388842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.389451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.389820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.390088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.391219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.391551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.393076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:09.398686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.399625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:09.400577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:09.400577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:09.400577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:09.400577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 368/748] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:09.400820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.415594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 381/749] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:09.416461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.446122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.473104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.516948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474254d-0b34-42a8-938b-57005e76a378 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.521056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878161d-280b-450e-8a7a-b9d2c3fa4224 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.552868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.553789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.554064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.554332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.555063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.555383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.556813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.559302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.559914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.560185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.560478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.561109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.562442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.579451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 369/750] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:09.579451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.591251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 382/751] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:09 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:09.597620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.699290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.708505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef15c7-05ba-49be-b067-d3ea67a79787 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.746556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33491c-08c8-4fc6-b0e3-b0cd4f4f3648 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.748370 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.749377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.749870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.750349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.751290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:09.751810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.753442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.762594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.776744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 370/752] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:09.777652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.802078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.802724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.802997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.803261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.815751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:09.817456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:09.836170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:09.837419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:09.838519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:09.838519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:09.838519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:09.838519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 383/753] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:09.838519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:09.916686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9374a7-6b37-498c-8e47-5e981795206a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.951248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ff021-d839-4b4b-bdf6-cef0e76a5a41 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:09.953239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.953833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.954111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.955105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:09.981566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:09.991422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:09.992739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:09.993158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:09.993694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.001327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.003151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:10.022984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:10.023961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:10.024903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:10.027248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 384/754] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:10.028172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.033562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.035039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.055959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.137863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3db340-684e-4606-8d18-0af38a32289a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.144490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 371/755] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:10.145531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.175537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.176796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.177195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.177591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.178327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.178723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.180404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.197819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 385/756] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:10.197819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.219296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.285048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511d9d3-374a-466e-a7e4-e3f6e16321a3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.288557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.306608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b02b6-fba3-4e17-80c4-06a0df6ce75f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.334396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.335729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.336450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.336899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.338066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.338932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.340968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.343226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.343937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.344625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.344625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.355457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.357121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.362066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 372/757] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:10.362066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:10.382948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:10.383988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:10.384954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:10.384954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:10.384954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:10.387712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 386/758] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:10.389069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.468022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a1535-a446-485a-9ffc-b6f29cc7cbdd None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.482876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.511450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.512652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.513109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.513786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.523706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f75d1-1e27-4324-bb5b-c7aeb2215b46 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.524218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.526128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:10.542358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:10.543502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:10.544648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:10.551689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 373/759] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:10.551689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.566784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.567924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.567924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.568128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.568825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.569131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.570611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.573556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.580426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 387/760] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/role_assignments?user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:10.580426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.718691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ce617-5198-490b-9a58-53a6a8d69850 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.730109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9b0f-b547-4273-8530-55b2c0a853a9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.771187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.772166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.772474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.772744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.773661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.773968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.776160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc54ee-943d-457b-84af-01301e4f059b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.781480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.782316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.782591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.782857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.783536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:10.783847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.785295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc724da7-3c68-4be0-bc93-60fc22fc9be7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:10.789839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 374/761] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:10.791257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab1ac-0bae-48fa-8b94-afc903db7399 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.791546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab1ac-0bae-48fa-8b94-afc903db7399 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.791808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ab1ac-0bae-48fa-8b94-afc903db7399 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.796491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 375/762] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:10.797309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ab1ac-0bae-48fa-8b94-afc903db7399 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.805244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 388/763] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:10.806748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.806958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.807228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.828634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:10.829831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:10.863173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.895299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:10.916031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 389/764] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:10.917479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:10.946895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ab1ac-0bae-48fa-8b94-afc903db7399 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:10.983945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:10.984529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:10.984803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:10.985062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:10.992272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:10.993863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:11.009198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:11.010118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:11.011048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:11.013767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 376/765] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:11.014994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.050624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e173fb-cb02-4608-9855-3e2437c38f56 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.095681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.096344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.096642 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.096906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/2d6406240f104443b75c8ec7d7999070/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.098866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=2d6406240f104443b75c8ec7d7999070, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.100299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.117495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 390/766] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:10 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/2d6406240f104443b75c8ec7d7999070/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:11.118708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.122913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.132506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6f682-de1c-4aed-8c10-1a94709c3a22 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.178363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.179205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.179542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.179943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.180715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.182373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.190559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:11.196169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:11.197434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:11.198320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:11.204925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 377/767] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:11.207443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.263497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e512f-0095-4642-a6ea-becac175bc79 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.302817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.303457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.303758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.303972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.304703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.305001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.306560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.321778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 391/768] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:11.327842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.328761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58aa4-0ddf-4792-a4aa-83725ee1c6b6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.367818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.368830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.369302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.369773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.370641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.371137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.372724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.383400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 378/769] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:11.385148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.413334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.441217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ce4f7-795c-4db9-b59c-6c7e72ad1f5f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.454179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.481887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.482582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.482855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.483116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.483838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=8ea2a62cdced4ef3b68868101b3c3dae) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.484138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.485713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.497027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 392/770] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/role_assignments?user.id=8ea2a62cdced4ef3b68868101b3c3dae&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:11.500180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf6509-7279-4e7f-8581-067fe18f6567 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.542491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.543484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.543956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.544440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.545293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.545791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.547369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.558672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 379/771] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:11.560872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.705959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12d981-aac6-4fb0-bb23-f39df7959c4c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.740319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:11.740999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.741267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.741534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.742233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] RBAC: Adding query filter params (interface=public, service_id=8a03abd915844179b85715a754da35d6, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:11.742545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:11.743874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcde2c7-f61a-4905-924f-41957dd597e9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:11.751889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 393/772] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/endpoints?service_id=8a03abd915844179b85715a754da35d6&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:11.758884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:11.809623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ca05-64b1-47a8-944e-7344c290af74 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.810174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ca05-64b1-47a8-944e-7344c290af74 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.810613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8ca05-64b1-47a8-944e-7344c290af74 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.812110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 394/773] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:11.819337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:11.819337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:11.819337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:11.851597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:11.855178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:11.909886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.922922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:11.950365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457e19c-5dd7-4eac-8ce0-efab19152ea6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:11.968665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 395/774] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:12.000738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.017251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.017875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.018145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.018404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.019012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.020641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.036749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 380/775] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/services => generated 772 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:12.163014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7fed3-f195-4ab4-b0a9-282e0da76bad None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.213656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.214311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.214587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.214855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.215449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.216867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:12.228099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:12.229145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:12.229982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 396/776] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:11 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:12.235211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.360523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae622e-7795-4390-9718-d21b248fa7a6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.410078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.410815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.411632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.411924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.412588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] RBAC: Adding query filter params (name=network) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:12.412891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.414320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.422466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 381/777] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:12.428321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.462239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.553699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b27b93-046a-4e1a-af9d-e038195b9bd1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.591765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.592400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.592672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.592944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.593573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:12.593868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.595225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.606591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 397/778] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:12.613112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.641295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.761480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abcda-3ab0-47ec-8919-e69692510655 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.811756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.812447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.812722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.812987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.813692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] RBAC: Adding query filter params (interface=public, service_id=22a543d3665b4f6b9ea96f60a1fb2894, region_id=RegionOne) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:12.813996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.815553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8ee5f-9190-4059-b306-31b321f43a1e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:12.826736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 382/779] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/endpoints?service_id=22a543d3665b4f6b9ea96f60a1fb2894&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:12.832167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:12.887240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf8aa-0b9f-4302-8acf-8182bb3d353b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.887240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf8aa-0b9f-4302-8acf-8182bb3d353b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.887240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcf8aa-0b9f-4302-8acf-8182bb3d353b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.887240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 383/780] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:12.898486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.898760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.899032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.932731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:12.933924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:12.958423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be467b97-ccb7-4777-8b9c-0ecf3db58da0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:12.989075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:12.996714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:12.997324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:12.997598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:12.997863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:12.998466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:12.999820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.014298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 398/781] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:12 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:13.119404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 384/782] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:13.153796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.272977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0559b1b-3408-4d27-a4b6-b49a0b15a1e5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.307282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.307925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.308200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.308503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.319033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:13.324104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:13.325096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:13.325955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 399/783] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:13.331487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.342131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:13.432918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b25b6-e437-40f0-81fa-ca8282231cf7 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.469098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.469709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.469983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.470247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.470918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:13.471210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:13.472599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.481936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 385/784] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:13.489784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.517302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:13.599706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff92f1-8796-428f-8f9d-afceb04835b9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.634434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.635060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.635331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.635596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.646684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:13.648123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:13.662135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:13.664090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:13.666132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:13.666132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:13.666132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:13.666132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 400/785] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:13.673692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.777709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:13.823196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bfbb8-6df4-4c6e-8bbc-2c3d4553b341 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:13.874153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:13.874754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:13.875031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:13.875298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:13.875950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:13.876251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:13.877651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a289f-10d6-47d7-bbc7-528855f8c6cd None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:13.898447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 386/786] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:13.903840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:13.999630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.039116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a87f2-bd7e-4028-bbd1-1245c8727b01 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.084161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.084832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.085105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.085371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.093541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:14.094979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:14.110618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:14.111807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:14.112975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:14.114202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432dc30-65af-4e05-9b9b-361552d0b4f3 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.114826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 401/787] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:14.115265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432dc30-65af-4e05-9b9b-361552d0b4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.115699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432dc30-65af-4e05-9b9b-361552d0b4f3 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.117571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 387/788] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:14.120531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.128304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.128832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.129275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.164092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:14.168329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:14.283434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4262a-9731-47a3-9c7a-4cdf9545e30d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.304959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 388/789] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:14.320830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.329522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.331707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.332497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.332737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.333098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.333825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:14.334134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:14.335604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:14.370616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 402/790] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:14.377912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.398184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.442792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a80f8-cc4a-49b7-b84a-b27cae2f0947 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.476720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a6b7-3b19-4d0e-9166-185f25140060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.477349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a6b7-3b19-4d0e-9166-185f25140060 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.477626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a6b7-3b19-4d0e-9166-185f25140060 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.477891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a6b7-3b19-4d0e-9166-185f25140060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.487246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcb830-6593-4ee7-85cb-e25ffcc5686a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.488234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a6b7-3b19-4d0e-9166-185f25140060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5cd3a6b7-3b19-4d0e-9166-185f25140060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:14.492978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:14.493917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 389/791] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:14.500232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329980a-2098-4e04-b7ce-def03ac43f98 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.501242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329980a-2098-4e04-b7ce-def03ac43f98 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.501242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329980a-2098-4e04-b7ce-def03ac43f98 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.501242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 390/792] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:14.501242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d4618-0852-40a6-9731-73ff24024f71 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.501242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d4618-0852-40a6-9731-73ff24024f71 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.501242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d4618-0852-40a6-9731-73ff24024f71 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.504071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 391/793] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:14.504899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d4618-0852-40a6-9731-73ff24024f71 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.532886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.533522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.533790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.534274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.544471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:14.545918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4b32d275-e8cb-4eaf-8da4-e9f3cdef54fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:14.560858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:14.561879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:14.562793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:14.562793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:14.562793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:14.566817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 403/794] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:14.568894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c265-9d21-4b3e-8777-db32b7b071d1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.568894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c265-9d21-4b3e-8777-db32b7b071d1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.569175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1c265-9d21-4b3e-8777-db32b7b071d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.589810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-82f1c265-9d21-4b3e-8777-db32b7b071d1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:14.591420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-82f1c265-9d21-4b3e-8777-db32b7b071d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:14.620219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d4618-0852-40a6-9731-73ff24024f71 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.629951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.642849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.658986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.659523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.659800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.660066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.660796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:14.661099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:14.662470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:14.664625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 404/795] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:14.666428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.667044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.667627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.683428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 392/796] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:14.684536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.686447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:14.687622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:14.761424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 405/797] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:14.772568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.812227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c02547-7e3a-4acf-b210-37043882d410 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.848458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.849064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.849338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.849603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.850220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:14.850510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:14.851929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:14.868184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 393/798] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:14.868184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.880644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e83a7-5267-48a3-92a7-19b54ae2ce55 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:14.884922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.923238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:14.923779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:14.924025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:14.924290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:14.924773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:14.937252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:14.942276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:14.943204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:14.944061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 406/799] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:14.944797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:14.986045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780dc38-4096-42e7-adcb-e30799b527fb None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.022390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.023020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.023275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.023540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.034763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.036164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:15.050230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.051222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:15.052110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:15.052110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:15.052110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:15.056100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 394/800] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:15.057001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.064561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82573c01-658d-4ed2-b540-0191fb163b0d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.102783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.103418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.103760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.104018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.104711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.106009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.114970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.115961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 12:10:15.116849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:15.121128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 407/801] 10.222.0.60 () {56 vars in 1129 bytes} [Tue Aug 9 12:10:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:15.121976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.149956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.161316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.170768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845231-8ed3-41cd-bf0b-32235334aa7c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.205591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.206510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.206789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.207068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.214550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.215877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:15.227218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.228086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 395/802] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:15.229471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.236534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86ddc-8926-4d7d-b4ce-31fa1d8b4cf6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.271748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.272344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.272674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.272947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.273609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.273906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.275293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.288227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 408/803] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.288227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.339578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0ddec-06f6-4ebf-a188-41582007d3e6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.375502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.376117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.376406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.376686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.377331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.377634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.379004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.389132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.391133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 396/804] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.391133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.407681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669a6ad-f0ce-4853-8bfd-2e1b7dc29650 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.408661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.446317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.446918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.447192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.447454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.448077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.448666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.449749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.458987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 409/805] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.458987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.506663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02b776-77a8-4f89-b117-c0b19488e591 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.541037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.541639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.541907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.542167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.542846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.543141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.544589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.556659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 397/806] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.557526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.566256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796c419-d0fa-463f-b1c5-3320de57a836 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.600711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.601363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.601638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.601904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.612341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.613823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:15.628207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.629284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:15.630376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:15.630376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:15.630376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:15.630977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.634340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 410/807] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:15.635088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.638919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.656828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb4711-8532-48e8-9045-a1d9d3a15cbe None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.689560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.690184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.690454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.690721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.698198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.699630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-96e1cb16-5c3c-48cd-aad0-168e1850f1d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:15.710615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:15.711586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:15.712555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 398/808] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:15.713161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985728-f5fb-4f03-861b-94d8eb1af394 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.713161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985728-f5fb-4f03-861b-94d8eb1af394 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.713505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74985728-f5fb-4f03-861b-94d8eb1af394 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.718893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 399/809] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:15.719577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985728-f5fb-4f03-861b-94d8eb1af394 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.736684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6b917-8198-4a94-92ad-a8de120ff148 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.771325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.771918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.772191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.772481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.773102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.773400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.774757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.779430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 411/810] 10.222.0.60 () {56 vars in 1124 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.780188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.822238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74985728-f5fb-4f03-861b-94d8eb1af394 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.851520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.855793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.856484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.856761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.857027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/f3b5cb27f7e64ea1b3a04dc71d1d36aa/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.858902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=f3b5cb27f7e64ea1b3a04dc71d1d36aa, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.860347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.862619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:15.874237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 400/811] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:15 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/f3b5cb27f7e64ea1b3a04dc71d1d36aa/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:15.875054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:15.904871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c242d6-a727-4a77-8d04-7e206fc9fc47 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:15.947142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:15.947918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.948194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.948494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.949153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:15.949453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:15.950855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6892924e-7296-44cc-b7df-7cf5cd5c6852 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:15.965286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 412/812] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:15.971144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:15.971419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:15.971695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:15.991206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:15.992454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:15.994563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52056bc-fb3a-44ed-95fc-2fac14a8e6d1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.037444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.038071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.038344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.038611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.039562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:16.039861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.042309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.062059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 401/813] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:16.063368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.087066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 413/814] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:16.088190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.125119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.155808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.178777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61c680-72a8-4a33-a7bb-372e0f403499 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.201368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6416354-f1fd-4db2-9403-622bfb2df973 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.214980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.215648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.215865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.216132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.216821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.218184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.248694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.255537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 402/815] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:16.255759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.255855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.255941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.255941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.263543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.266121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:16.283903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:16.285120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:16.287163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:16.291210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 414/816] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:16.292523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.377007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddee674-383e-426a-9df7-2dc766c95ba4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.388505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.425600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.426335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.426674 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.427004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.453512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2c2c0-dbaf-4c4a-94dc-7bdc77bbd405 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.473854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.498681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.499700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.500051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.500451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] PATH_INFO: `/v3/services/network` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.501047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.502469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:16.513322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:16.514558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:16.515932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 415/817] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:16.520804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.522262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.524236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.642204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 403/818] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:16.643280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.649660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826a697-8590-4c35-a4ff-cd20da0b2973 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.654946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.687257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.688109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.688550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.688954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.689840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:16.690276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.691867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.710178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 416/819] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:16.711285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.746464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.757086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326954c-5759-48d0-be2d-5f666066f497 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.793331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.794140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.794515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.794879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.795656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:16.796054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.797558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.807210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 404/820] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:16.807210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.822574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09453905-73a3-49a0-9e6c-5a085e6f261e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.858314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.859191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.859606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.860008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.870934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.872765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.878147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:16.895619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:16.896898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:16.897990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:16.897990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:16.897990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:16.899735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 417/821] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:16.900745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:16.919143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1974edf-a8a3-4a66-9ef9-9f55f0e5aab0 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:16.969304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:16.970520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:16.970800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:16.971068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:16.986102 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:16.987874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:16.998549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:17.008568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:17.009699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:17.010673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:17.010673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:17.010673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:17.012103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8ad08-ff76-4d8a-a5d4-bd1c93cfbaaa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.012515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 405/822] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:17.013567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.055886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.056534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.056809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.057074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.057703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] RBAC: Adding query filter params (type=network) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:17.058053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.059930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.071745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 418/823] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:17.071745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.130091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5ea26-e81b-4202-8877-d72b845876bb None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.159854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.174332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.175193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.175468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.175736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.176505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:17.177138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.179094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.180827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5cd1e-c0ff-4504-b108-a82f38a2c416 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.193972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 406/824] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:17.194784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.215877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.216807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.217304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.217764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.218586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:17.219078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.220655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.233063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 419/825] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:17.234148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.250519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.307789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f65eb-a432-4419-9674-39f2b568cb1a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.342961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.343954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.344458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.344916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.345756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.347318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.362227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8c466-583d-4859-9b70-a5ab9f0b7a81 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.375372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 407/826] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:17.380794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.408794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.409485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.409753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.410012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.424411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.424411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:17.433590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:17.434515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:17.435406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 420/827] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:17.440814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.480129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.532005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.571482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33b7e5-93d3-4991-b91b-9c543de31de9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.613137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.613137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.613137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.613137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.613553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:17.614673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.616338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.622122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9710d8f-2fd0-4da2-9f23-339758cddfc9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.631018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 421/828] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:17.637486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.659257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.660237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.660867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.661362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.669884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.671766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:17.684962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:17.685932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:17.686847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:17.689344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 408/829] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:17.695847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.757987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb466992-e6c8-4ef6-98f4-2569b0f57e94 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.787609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.796349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.797344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.797821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.798440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.799482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=2d6406240f104443b75c8ec7d7999070) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:17.800005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.801890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.802399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:17.805291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff8a11-d91b-4160-a3f3-b210ac7fa262 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:17.813126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 422/830] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/role_assignments?user.id=2d6406240f104443b75c8ec7d7999070&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:17.845304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:17.846091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.846477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.846838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.847631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:17.848058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:17.849887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b55f04-18e1-436e-b852-358027eb545d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:17.864089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 409/831] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:17.870196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:17.954577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40ee8b-bdff-46c8-919d-1018aebe4a66 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.954926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40ee8b-bdff-46c8-919d-1018aebe4a66 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.955119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40ee8b-bdff-46c8-919d-1018aebe4a66 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.956870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 410/832] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:17.962689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:17.962980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:17.963221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:17.983404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:17.984837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:18.003999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18070-5b3e-4094-b3a2-d238ca8afa25 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.042195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.042936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.043529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.043654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/8ea2a62cdced4ef3b68868101b3c3dae/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.059998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=8ea2a62cdced4ef3b68868101b3c3dae, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.061651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.061915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 411/833] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:18.077860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 423/834] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:17 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/8ea2a62cdced4ef3b68868101b3c3dae/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:18.088481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.195426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.205851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bdbf1-bbbf-4021-a6db-c7fdaed731f0 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.251529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.252178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.252476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.252748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.265955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:18.270700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:18.271708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:18.272560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 412/835] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:18.278350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.323171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.382595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10aef8-3c54-490a-ab67-f0ddd917f84c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.417922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.418535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.418810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.419080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.419741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:18.420040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.421448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e406a-534b-4ee4-96a3-d28c13044bbf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.430633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 424/836] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:18.435956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.503122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eeaea-3dce-4e6a-b028-a12e109af399 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.503471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eeaea-3dce-4e6a-b028-a12e109af399 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.503671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eeaea-3dce-4e6a-b028-a12e109af399 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.505166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 425/837] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:18.510148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.510432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.510707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.532279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:18.533512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:18.543285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec0a9-26f1-4049-9fea-de651263056b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.592262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.592936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.593160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.593427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.610014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.611641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.622241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 426/838] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:18.630393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:18.631366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:18.632264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:18.632264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:18.632264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:18.634346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 413/839] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:18.642518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.644762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.648214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.677863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.762123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808df54-72ff-49b8-ab58-423dc818cb20 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.770998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c864cdf-688c-49c1-89cd-0a5895c8d169 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.798895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.799593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.799930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.800266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.800989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:18.801432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.802875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.815174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 427/840] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:18.821543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.822367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.823014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.823287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.823551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:18.824241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:18.825653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:18.835015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:18.836016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:18.836899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 414/841] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:18.841980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:18.931231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.936716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:18.944530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c080a6-40dd-4e13-a729-3306f1939712 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.976822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542e01-7ee4-40f9-aeba-8dcc220bde3e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:18.988957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:18.990103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:18.991086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:18.991561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.002305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.004941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.011530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.012213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.012577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.012909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.013615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:19.013989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.015820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.025024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 415/842] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:19.025166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:19.026050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:19.027358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 428/843] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:19.033817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.034054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.145545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bacc-e6ea-41cf-9954-f2edbb417907 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.161002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452db8c9-11b8-40b0-9626-c497f2bc06f5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.180536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.188130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.189292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.189769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.190235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.191275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:19.191882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.193770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.201391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.202006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.202287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.202547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.203177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:19.203473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.204864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.214297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 429/845] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:19.214455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 416/845] 10.222.0.60 () {56 vars in 1135 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:19.218918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.248833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.337300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35625cdf-a90e-470e-9cc2-55cba847b8bb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.374842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.375463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.375735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.375996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.446421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.447773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.466530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.549655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 430/846] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:19.555696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.663408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33587042-070d-4b10-b9e5-0af77314662d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.698787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.699332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.699604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.699865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.710726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.712175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:19.727020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:19.728897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:19.730634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:19.730634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:19.730634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:19.730634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 417/847] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:19.737540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.841462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916eaec-1aa0-4e33-a2b2-407eb69f6317 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:19.860711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:19.879252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:19.880088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:19.886326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:19.886326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:19.886326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:19.886326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:19.886326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:19.899875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 431/848] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:19.901284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:19.944732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.005714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f638d-ba6a-4161-85e5-eccab6a5877b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.040809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.041454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.041726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.041995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.048915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.050361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9ff2d37a-76b5-4a80-b5b0-dba8446b53fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:20.061870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:20.063880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:20.065977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:20.068415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 418/849] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:20.069813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.085604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856764d3-968a-4560-9a07-a8f39a97adb0 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.086153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856764d3-968a-4560-9a07-a8f39a97adb0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.086568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856764d3-968a-4560-9a07-a8f39a97adb0 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.088465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 419/850] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:20.093248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9d9d-9e65-4f4b-86a0-82a73b75bf89 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.093735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9d9d-9e65-4f4b-86a0-82a73b75bf89 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.094154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc9d9d-9e65-4f4b-86a0-82a73b75bf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.119343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f0bc9d9d-9e65-4f4b-86a0-82a73b75bf89 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:20.120546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f0bc9d9d-9e65-4f4b-86a0-82a73b75bf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:20.189513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358d1cd-33a0-4c64-b963-881d2f4167e0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.189723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 420/851] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:20.190755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c14611-ba53-4ce6-820f-1dba74ec55bc None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.191034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c14611-ba53-4ce6-820f-1dba74ec55bc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.191298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c14611-ba53-4ce6-820f-1dba74ec55bc None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.192942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 421/852] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:20.197652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.197998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.198331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.217100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:20.218487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:20.225361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.225966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.226240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.226585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.227299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:20.227601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.229049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.246415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 432/853] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:20.246415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.246639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.285241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.295290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 422/854] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:20.305533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.347710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01345cc-56aa-4934-9cf7-a6dc75e8ffb2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.385086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.385723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.385992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.386261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.386835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.388193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:20.397752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:20.398749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:20.399688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 433/855] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:20.401704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.422760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4c942-baf1-466e-9201-85a2bf35dd16 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.459311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.459957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.460200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.460508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.461253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:20.461555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.463028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.469656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 423/856] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/role_assignments?user.id=f3b5cb27f7e64ea1b3a04dc71d1d36aa&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:20.470450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.505622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.530862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3defa29d-0e90-46f7-b7c2-5493e7e46ec8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.533935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.591949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.593212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.593708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.594473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.602043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d9e9-f7dc-43f9-87dd-b57e762556e8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.611823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:20.620025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:20.621104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:10:20.621938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:20.624760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 434/857] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:20.630694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.650535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.651150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.651592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.651868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.652913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:20.653352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.655004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.662416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 424/858] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:20.668365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.750158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ec167-968f-4c07-91b3-2213b9f672d3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.777300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.790528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdfac4-7e3a-4727-af08-9496b11e8478 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.796128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.796766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.797039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.797303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.797965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:20.798767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.800148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.811652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 435/859] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:20.817218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:20.831459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.832079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.832490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.832942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.833768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:20.834126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.835560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:20.840919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 425/860] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:20.843663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:20.943538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f472d-3cab-4771-8310-019b7b349070 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:20.981775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:20.982698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:20.983116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:20.983555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:20.995825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:20.997536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:21.012311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:21.013532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:21.014617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:21.014617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:21.014617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:21.020738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 436/861] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:21.022677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.128138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012618b0-3ef2-4426-b155-45cdc5eb570e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.162852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.163783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.164192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.164616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.165385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:21.165821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.167328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.180296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 426/862] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:21.186089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.280785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.301419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460dabd-d281-4d9d-a8d5-1134088fc1b2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.360173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.361298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.361770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.362231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.375743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.378460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-18b2bb3c-432b-4e92-bafc-c68cff0cbe2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:21.399438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:21.400466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:21.401436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:21.402511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 437/863] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:21.410605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.435440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.440035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1af43-3a8c-427a-ba98-4bfaa672f6bb None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.440564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1af43-3a8c-427a-ba98-4bfaa672f6bb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.441008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1af43-3a8c-427a-ba98-4bfaa672f6bb None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.444943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 438/864] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:21.455056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.455330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.455601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.481302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:21.482844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:21.542017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fbdbb-ce11-45b0-b177-a6df093876bf None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.577917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.578890 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.579366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.579855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.584142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 439/865] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:21.585215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:21.592975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.592975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.604415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.620742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 427/866] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:21.622625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:21.693790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.697606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.731087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8609b62-ffb8-47ff-ac1f-f1385c00c42f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.749972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61878d8f-054a-41a3-a71c-408f98fd6c23 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:21.771472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.772078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.772352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.772643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.802703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:21.803863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:21.804555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:21.804856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:21.806242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.807619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.826113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 440/867] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:21 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:21.861680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:21.863919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:21.959164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:21.996091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 428/868] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:22.001867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.123093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b3a7a-a40b-499f-982c-5e672f6e67b2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.149000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.161885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.162859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.163334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.163814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.175039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.177280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:22.191872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:22.193457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:22.194383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:22.194383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:22.194383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:22.196609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 441/869] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:22.202182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.309122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a6f1-6f03-448f-8c5e-4d9ec10d7b50 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.345862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.346885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.347342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.347785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.349343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:22.349825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.351379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.363926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 429/870] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:22.370472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.474425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228f575-6910-4fc7-ba45-3d20d1a46095 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.508889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.509871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.510338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.510780 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.518228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.519995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:22.531625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:22.532551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:22.533462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:22.540013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 442/871] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:22.541617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.575392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.650227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf25bc2-b26e-444c-b3cd-2b575d17077f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.685599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.686534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.686964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.687373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.688205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:22.688675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.690266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242582d-1129-4053-94d7-a4a082d30119 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.708676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 430/872] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:22.710308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.739154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a41e-3813-44c6-8aea-23c8e6679eef None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.739519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a41e-3813-44c6-8aea-23c8e6679eef None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.739661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6a41e-3813-44c6-8aea-23c8e6679eef None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.741365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 431/873] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:22.746686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f0940-27cf-4e31-84d8-90443e99c8ec None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.746925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f0940-27cf-4e31-84d8-90443e99c8ec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.747278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f0940-27cf-4e31-84d8-90443e99c8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.755755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.770288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-be2f0940-27cf-4e31-84d8-90443e99c8ec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:22.771488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-be2f0940-27cf-4e31-84d8-90443e99c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:22.837890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4db186-3a05-4926-bb19-deecf911696c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:22.854802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 432/874] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:22.856191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8cb7c-2e20-45f8-a44a-878f45a6ac2e None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.856531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8cb7c-2e20-45f8-a44a-878f45a6ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.856786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8cb7c-2e20-45f8-a44a-878f45a6ac2e None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.858128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 433/875] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:22.863103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.863377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.863855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.883606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:22.884885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:22.890993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:22.891608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:22.891881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:22.892145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:22.892915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=8ea2a62cdced4ef3b68868101b3c3dae) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:22.893275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:22.894707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:22.900680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:22.901250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 443/876] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/role_assignments?user.id=8ea2a62cdced4ef3b68868101b3c3dae&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:22.902039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:22.971980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 434/877] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:22.997536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.027045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.032707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b60a2-1fa7-4c3a-8554-2aa1d3c6cc73 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.072429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.073323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.073783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.074260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.075111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.076671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:23.087787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:23.089227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:23.090225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 444/878] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:23.095779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.142294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48f025-f867-4ad6-82d6-3380fee0fef6 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.184446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.185072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.185346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.185877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.186524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.189455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.209215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86d00-851f-4255-b20d-71979b3d565e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.209578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 435/879] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:22 2022] POST /identity/v3/services => generated 269 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:23.256828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.257956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.258535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.259040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.259981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:23.260531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.262162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bb08f-8167-4f55-bacc-243a11a26d4b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.268984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 445/880] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:23.283954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:23.299917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:23.412775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c423f9d-1ada-4dd5-8801-a323e7114722 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:23.449914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:23.450919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.451423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.451920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.452792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:23.453350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:23.454929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddef9f-0837-44a4-b4fb-c875bf91c341 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:23.460678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 436/881] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:23.947774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837c6e-6b6f-4083-b785-5d40d24a32db None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.948299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837c6e-6b6f-4083-b785-5d40d24a32db None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.948299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837c6e-6b6f-4083-b785-5d40d24a32db None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.950009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 446/882] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:23.955320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:23.955724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:23.955911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:23.974858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:23.976052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:24.049182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 437/883] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:24.072211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837c6e-6b6f-4083-b785-5d40d24a32db None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.103385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.184736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837c6e-6b6f-4083-b785-5d40d24a32db None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.224564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.225563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.226014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.226456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.227209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.228785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:24.238207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:24.239933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:24.240828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:24.247889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 447/884] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:24.249441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.259312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.350455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9999-89f3-47e1-abb3-c22e0aeef69e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.385228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.386173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.386639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.387120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.387943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:24.388452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.390093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.396182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 438/885] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:24.408247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.498420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.513664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c510def-cf55-4bfb-9a78-7c7a7f0e34e3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.549382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.549989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.550264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.550533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.551488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:24.552169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.553571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.563468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 448/886] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:24.564965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.637188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:24.671321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6f8de-e0d1-45d5-b334-57c845664492 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.706645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.707280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.707566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.707814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.708520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] RBAC: Adding query filter params (interface=public, service_id=97af1235ab9e46abb2c01fe2eb7bb359, region_id=RegionOne) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:24.708818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.710173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef729b9-cf74-4bd8-8090-7ff9c39e5aa7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.715542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 439/887] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/endpoints?service_id=97af1235ab9e46abb2c01fe2eb7bb359&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:24.720959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:24.828279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf10b7-b4ab-4088-ae99-47c7a1692a67 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:24.864556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45d9a2-0b2f-488e-9576-807a91ddfcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:24.865168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d9a2-0b2f-488e-9576-807a91ddfcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:24.865440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d9a2-0b2f-488e-9576-807a91ddfcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:24.865699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45d9a2-0b2f-488e-9576-807a91ddfcc0 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:24.866299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45d9a2-0b2f-488e-9576-807a91ddfcc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:24.867671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45d9a2-0b2f-488e-9576-807a91ddfcc0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:24.878632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 449/888] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:24 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:25.160471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d64f-33bb-448e-8d80-780fb336acbe None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.160974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d64f-33bb-448e-8d80-780fb336acbe None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.160974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d64f-33bb-448e-8d80-780fb336acbe None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.162605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 440/889] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:25.167741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e89f2-265d-4d19-9087-493acfcde419 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.168151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e89f2-265d-4d19-9087-493acfcde419 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.168325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e89f2-265d-4d19-9087-493acfcde419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.187014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6d4e89f2-265d-4d19-9087-493acfcde419 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:25.188255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6d4e89f2-265d-4d19-9087-493acfcde419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:25.198284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.257059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 450/890] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:25.280262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d64f-33bb-448e-8d80-780fb336acbe None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.327488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e656e1-3497-4620-9736-dacdec7cbe33 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.327766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e656e1-3497-4620-9736-dacdec7cbe33 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.328205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e656e1-3497-4620-9736-dacdec7cbe33 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.329895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 451/891] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:25.334816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.335171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.335511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.353729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:25.355024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:25.390731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d64f-33bb-448e-8d80-780fb336acbe None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.428816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.432880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 452/892] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:25.436526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.437420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.437869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.438355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.449765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:25.451246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:25.456270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:25.457427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:25.458491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:25.461744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 441/893] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:25.467835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.532685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.558489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a5e08-0323-4446-9c87-eea1541fff2e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.582290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609abb-e32b-432b-afad-c40a02c2e2e4 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.592960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.593603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.593879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.594181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.594734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.596172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-2db0d884-f232-4424-affc-8f728a8ea662 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:25.605307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:25.606296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:25.607199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 453/894] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:25.612614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14af28-a1c0-4f5c-b800-a2effff03de1 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.612898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14af28-a1c0-4f5c-b800-a2effff03de1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.613172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14af28-a1c0-4f5c-b800-a2effff03de1 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.614592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 454/895] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:25.615205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14af28-a1c0-4f5c-b800-a2effff03de1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.626141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.626870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.627186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.627545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.628358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:25.628768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.630471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a35c0-aa48-47f4-ad36-32467eba0d05 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.639413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 442/896] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:25.641794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.642077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.642344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.661472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:25.662705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:25.715274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.728238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14af28-a1c0-4f5c-b800-a2effff03de1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.733061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 443/897] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:25.733691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.774255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.774869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.775145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.775400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.776035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:25.776339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.777739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.782526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 455/898] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:25.783289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.786544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:25.848645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d334ac-aed9-4d8e-9bba-97a68ad81e6c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.888505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.889513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.889979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.890690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.905380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.905546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d374fc-f6e1-4094-8b28-a7dfcac907d8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:25.906981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:25.925741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:25.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:25.928130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:25.928130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:25.928130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:25.931693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 444/899] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:25.932581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.943732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:25.944468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:25.944782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:25.945125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:25.945822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:25.947257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:25.966552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 456/900] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:25 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:25.967322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:25.977645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.038793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.069121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b5622-a40e-4f30-a00f-4a0275b54701 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.089325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5b0ed-a0fd-4b24-8b02-7c8c4597637e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.111884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.112937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.113577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.114048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.115134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.115685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.117418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.128518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 445/901] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:26.129940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.131852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.132514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.132784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.133050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.133704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.133995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.135353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.148141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 457/902] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:26.155541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.248958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.252700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b14824-51ad-4f13-b085-f0b59dc0653d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.275458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23c6f-19cd-4094-8ea2-c7cf7dcd21a6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.295995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.297239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.298545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.299070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.299482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.301097 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] RBAC: Adding query filter params (interface=public, service_id=c9a31dedace745d6b922c25a5c83d124, region_id=RegionOne) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.301865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.304700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.314884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 446/903] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/endpoints?service_id=c9a31dedace745d6b922c25a5c83d124&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:26.320416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.320898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.321548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.321823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.322098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.330325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.331922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:26.347123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:26.348327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:26.349531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:26.352462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 458/904] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:26.354309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.450140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc87e9-ec32-4933-b927-90e6fb85467b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.488645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dde451-bff7-44aa-9a5f-c7d20696bdad None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.491530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.492438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.492816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.493172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.494724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.496209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.508481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 447/905] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:10:26.532244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.533051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.533416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.533777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.534616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:26.535018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.536758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.557706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 459/906] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:26.563648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.596747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.682394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3d1c4-e5c0-428f-807d-a8756c0b3be7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:26.719187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb51a3-7e14-48e3-a8b6-69b9d14bd6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:26.720161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb51a3-7e14-48e3-a8b6-69b9d14bd6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.720691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb51a3-7e14-48e3-a8b6-69b9d14bd6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.721161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb51a3-7e14-48e3-a8b6-69b9d14bd6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.792519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb51a3-7e14-48e3-a8b6-69b9d14bd6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:26.794512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb51a3-7e14-48e3-a8b6-69b9d14bd6f6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:26.823069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.899292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 448/907] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:26.905529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:26.927215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c22281-4dbd-4d42-9bfc-9330d8699501 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.927570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c22281-4dbd-4d42-9bfc-9330d8699501 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.927764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c22281-4dbd-4d42-9bfc-9330d8699501 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.929388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 449/908] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:26.935730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:26.936010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:26.936281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:26.953443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:26.957226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:26.958675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:27.025289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0d237-f35c-4008-8f9a-afab3076c1af None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.044561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 450/909] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:27.061509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.064670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.065327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.065600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.067131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.080950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.083170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:27.103037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:27.104047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:27.105009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:27.105009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:27.105009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:27.106081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 460/910] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:27.112497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.144813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.194296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836ed90-82c8-4f70-b702-a3905c604079 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.224048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.239332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a533c5-7f7a-4e04-b67c-c6e2cc209bd1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.241417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.243175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.243675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.244162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.244962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.246544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:27.259244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:27.260741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 12:10:27.261636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:27.270239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 451/911] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:27.272258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.283899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.284558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.284835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.285106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.286236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:27.286543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.287962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.305725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 461/912] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:27.310991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.394246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d3996-042e-47e5-bd64-3d04dc07c10a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.423169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.434285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5b163-dbb0-40c7-8177-0d03d443e6fe None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.439054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.439662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.439935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.440200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.440851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:27.441147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.442831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.451259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 452/913] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:27.457524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.474440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.475374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.475843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.476292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.483843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.485643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:27.497621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:27.498725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:27.499852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:27.502325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 462/914] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:27.508992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.522683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.586443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5fe0-6097-41f1-923f-8bac492ef2d0 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.622216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c58c1-c068-4f8e-8809-a3cbf0bdc9e7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.626833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.627611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.627891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.628160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.628816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:27.629298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.630542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.636437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 453/915] 10.222.0.60 () {56 vars in 1114 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:27.642076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.676118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.676118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.676118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.676118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.676604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:27.676604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.676604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.692464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 463/916] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:27.696523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:27.707728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.763623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae049-fef6-4b19-b95a-c9d1b3439a40 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.768565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:27.800100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa740556-4938-4af4-ae29-930320da29ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.800728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740556-4938-4af4-ae29-930320da29ba None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.801027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740556-4938-4af4-ae29-930320da29ba None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.801290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740556-4938-4af4-ae29-930320da29ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.802006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa740556-4938-4af4-ae29-930320da29ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.803374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa740556-4938-4af4-ae29-930320da29ba None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.805506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48003f-5563-4231-8137-3bd10bd07ffb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:27.826397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 454/917] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:27.854406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:27.855395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:27.855817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:27.856217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:27.857232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] RBAC: Adding query filter params (role.id=db1890d2d345456582075dae63d0a3cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=8ea2a62cdced4ef3b68868101b3c3dae) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:27.857678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:27.859357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2a007-e0ba-4182-8aa0-0cef8f0e8214 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:27.866805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 464/918] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:27 2022] GET /identity/v3/role_assignments?user.id=8ea2a62cdced4ef3b68868101b3c3dae&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=db1890d2d345456582075dae63d0a3cf => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:28.096469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cad18-2895-4679-ac15-f72dda2e3677 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.096849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cad18-2895-4679-ac15-f72dda2e3677 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.097053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cad18-2895-4679-ac15-f72dda2e3677 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.098687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 455/919] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:28.103978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.104265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.104631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.123511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:28.124732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:28.199192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 465/920] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:28.226288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cad18-2895-4679-ac15-f72dda2e3677 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:28.339656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cad18-2895-4679-ac15-f72dda2e3677 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:28.347173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:28.378311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:28.380136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.380796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.381069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.381661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:28.383479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:28.392938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:28.394157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:28.395118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 456/921] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:28.402228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:28.461469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:28.505071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ffb97e-5156-4d48-a8c6-5cef52a832a5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:28.545099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:28.545706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.545976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.546237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.546863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:28.547161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:28.548535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98304888-7157-4f75-9ab7-3373ced653d0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:28.553654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 466/922] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:28.559228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:28.664596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc209-0f36-4a4c-9f83-1cd89f52a4af None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.664772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc209-0f36-4a4c-9f83-1cd89f52a4af None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.665071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddc209-0f36-4a4c-9f83-1cd89f52a4af None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.666768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 467/923] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:28.672461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066066-6af9-4762-89aa-a3021310d658 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.672761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066066-6af9-4762-89aa-a3021310d658 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.673031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94066066-6af9-4762-89aa-a3021310d658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.674309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb3dd4-9568-495e-b455-177e0d5c9277 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:28.696104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-94066066-6af9-4762-89aa-a3021310d658 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:28.697717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94066066-6af9-4762-89aa-a3021310d658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:28.715617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:28.716230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.716761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.717016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.718131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:28.718430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:28.720782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:28.727907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 457/924] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:28.733781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:28.776184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:28.788405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 468/925] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:28.810507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94066066-6af9-4762-89aa-a3021310d658 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:28.855807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a90e36-685a-4b02-909f-0b22790082eb None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:28.867137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:28.901494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:28.902277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.902647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.903096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.904013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] RBAC: Adding query filter params (interface=public, service_id=bc19ef5c528448ef9404889ae0fd8789, region_id=RegionOne) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:28.904449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:28.905905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:28.911913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 458/926] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:28 2022] GET /identity/v3/endpoints?service_id=bc19ef5c528448ef9404889ae0fd8789&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:28.917587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:28.927496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94066066-6af9-4762-89aa-a3021310d658 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:28.981348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:28.982648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:28.984992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:28.985383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:28.985986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:28.987425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:29.003327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:29.004706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 12:10:29.005680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:29.006783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 469/927] 10.222.0.60 () {56 vars in 1132 bytes} [Tue Aug 9 12:10:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:29.012679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.057033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.061085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46595-3542-43a3-aff4-47a821cb5af7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.098228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.098854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.099125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.099371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.099967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.101355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.116407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 459/928] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:28 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:10:29.155420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00598ae2-356e-430e-9c2d-fedb4ae2642f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.173945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:29.194151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.194785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.195053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.195318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.195952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:29.196251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.197761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.203564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 470/929] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:29.209557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.312639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ad9bc-15fd-4275-97cb-ac87ea022a94 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.351969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.352706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.352984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.353301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.353934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:29.354234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.355608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81978ad0-1462-450a-9690-2ad4d433bd10 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.360942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 460/930] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:29.366887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:29.479272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38817652-ef4b-4902-a595-a1becd0a55b6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:29.516068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6803aad-2d95-41e1-812e-b2bb5b3e72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:29.516867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6803aad-2d95-41e1-812e-b2bb5b3e72d4 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.517237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6803aad-2d95-41e1-812e-b2bb5b3e72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.517601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6803aad-2d95-41e1-812e-b2bb5b3e72d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.518470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6803aad-2d95-41e1-812e-b2bb5b3e72d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:29.520721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6803aad-2d95-41e1-812e-b2bb5b3e72d4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:29.546425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 471/931] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:29.971074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156dd4-5f00-4a89-b334-cb71cf7a7d99 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.971347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156dd4-5f00-4a89-b334-cb71cf7a7d99 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.971617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156dd4-5f00-4a89-b334-cb71cf7a7d99 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.973629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 461/932] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:29.978849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.979131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.979402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:29.999365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba359f8a-2146-4c49-b62b-f334c01c80f9 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:29.999689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba359f8a-2146-4c49-b62b-f334c01c80f9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:29.999907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba359f8a-2146-4c49-b62b-f334c01c80f9 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.008450 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:30.008658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 462/933] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:30.008767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:30.010675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.011159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.011620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.030660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:30.032201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:30.040012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.056028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.099255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 472/934] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:30.108055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 463/935] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:30.123187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.132758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.224695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80a18f-36df-4a7b-931d-65dc26d63a81 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.235344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebbc73-587b-4340-a003-632144ae018c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.277709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.278320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.278826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.279105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.279828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.281980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.284613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING keystone.server.flask.common [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 12:10:30.285754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.286607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.287072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.287536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.301329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:30.307874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.sql.core [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 12:10:30.307874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 12:10:30.307874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [parameters: {'id': 'e3a1249f84cc412985b23a4bfc35d71e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 12:10:30.307874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80178) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:30.308797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:30.309712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:30.310556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:30.313205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 464/936] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:30.324421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e3a1249f84cc412985b23a4bfc35d71e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e3a1249f84cc412985b23a4bfc35d71e. Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:30.327009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 12:10:30.327899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application yield resource Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise self.value Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application session.commit() Aug 09 12:10:30.328960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.session.flush() Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application compat.raise_( Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 12:10:30.329845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 12:10:30.330747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:30.331767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [parameters: {'id': 'e3a1249f84cc412985b23a4bfc35d71e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.333663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:30.335068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e3a1249f84cc412985b23a4bfc35d71e. Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 473/937] 10.222.0.60 () {60 vars in 1140 bytes} [Tue Aug 9 12:10:30 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:30.336617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.355371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.358970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.459817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e368431-ad7c-4c13-8001-eb31e3e5d5e2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.464527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef0284-d8f2-4703-b50c-01c62ba51e1c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.499419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.500865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.501372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.501874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.502210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.502859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.503135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.503402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.504076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:30.504369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.506445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.510553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.512431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.516456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 465/938] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:30.521720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:30.524964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:30.525844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:30.526724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:30.529031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 474/939] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:30.542577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.605197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.628221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc4057-0490-42a8-9a3d-db9a3762d3db None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.648037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.666292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.667005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.667284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.667551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.675178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6451bfd-5d3c-40e4-a256-26d19afbb250 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.679578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.681169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:30.696490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:30.697685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:30.698762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:30.698762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:30.698762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:30.702513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 466/940] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:30.703441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:30.717734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.718901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.719349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.719942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.721199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:30.721966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.723777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.760968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 475/941] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:30.822226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bbb7c-1c62-429e-b10d-68e4cac2d20f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:30.853666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:30.861052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:30.861681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:30.861947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:30.862212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:30.862862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:30.863162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:30.864703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:30.878170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 467/942] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:30.891058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.000248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaccc6c-2509-4e8d-b4af-d66eac191a1b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.034621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.035482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.035925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.036197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.043691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.045210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.046992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:31.058842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:31.059830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:31.060835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 476/943] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:31.066084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.170985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b7c18-c3f0-4114-98d1-607ad7daff71 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.205249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.205856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.206124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.206441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.207400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:31.207793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.209530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75ac3c-1397-412e-ad37-062f935d51d4 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.228650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 468/944] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:31.234297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.297746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119f7d2-ac95-4e96-8ece-f7efe1fc7208 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.297928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119f7d2-ac95-4e96-8ece-f7efe1fc7208 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.298202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119f7d2-ac95-4e96-8ece-f7efe1fc7208 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.299821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 469/945] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:31.304984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.305262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.305528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.323627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:31.324846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:31.347085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577d668-f049-4535-bc5d-5593e5517424 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.375345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.383066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.383708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.383986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.384254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.395764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.397270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.404611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 470/946] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:31.418916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:31.419900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:31.420857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:31.420857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:31.420857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:31.420857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 477/947] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:31.426116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.429367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.482855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.543842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a7b08-8c46-44a2-a167-c4d2a9c0315a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.550602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec6374-4a76-4823-8569-ad138c84944f None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.586968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.587695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.587975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.588258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.589048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.590161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.590880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.591121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.591539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.591979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.593096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:31.593975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.595739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:31.601398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:31.602615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:31.603560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:31.608882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 478/948] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:31.611519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.611686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 471/949] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:31.617783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.674517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.720644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d218a4-18b2-466b-97dc-a3092ee4ddca None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.736108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.749995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e2e64-ddf8-490f-a280-75e12cf3a3c3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.757823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.758431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.758705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.758972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.759597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:31.759897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.761293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24442dcb-c6a3-4e94-9efc-b998a0dd1b4d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.766881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 479/950] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:31.767958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4774f-83e1-4319-beaa-5c6b38c14b6b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.768239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4774f-83e1-4319-beaa-5c6b38c14b6b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.768541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4774f-83e1-4319-beaa-5c6b38c14b6b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.772743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 480/951] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:31.772743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4774f-83e1-4319-beaa-5c6b38c14b6b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.789607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.790240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.790514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.790781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.797787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.799218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-2c7aafae-b369-4613-9f03-a4b8e84f9580 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:31.810904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:31.811798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:31.812766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 472/952] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:31.813260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.813766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.813766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.831172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:31.832565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:31.897361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4774f-83e1-4319-beaa-5c6b38c14b6b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:31.905649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 473/953] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:31.906364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.936038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:31.940430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:31.941125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:31.941309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:31.941596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:31.942395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:31.942692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:31.944409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:31.949208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 481/954] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:31.953735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:31.998076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:32.018100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407582e-eda6-4f43-80b4-35c2a8538188 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.054313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.054923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.055193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.055452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.056130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:32.056458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.057992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.062481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb016ac-364f-4716-b324-440513fdcac3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.075998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 474/955] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:32.075998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:32.102699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.103856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.104144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.104693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.105286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.107144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:32.116006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:32.123013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:32.123933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 482/956] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:32.124913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:32.186042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:32.206839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f8b51-3096-4b58-9624-f77874fc545b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.242663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b0228-763f-47cd-b26b-aa236d90ab90 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.250190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:32.251478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.252723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.253193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.254034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.255113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.256940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.281332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.281986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.282256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.282518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/8ea2a62cdced4ef3b68868101b3c3dae/roles/db1890d2d345456582075dae63d0a3cf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.284676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=8ea2a62cdced4ef3b68868101b3c3dae, role_id=db1890d2d345456582075dae63d0a3cf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.292672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 475/957] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:32.292672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:32.292965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.316662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 483/958] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:32 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/8ea2a62cdced4ef3b68868101b3c3dae/roles/db1890d2d345456582075dae63d0a3cf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:32.438368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb935a5-066e-41f8-a5ee-b2537acb3fb2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.483062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.484026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.484521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.484983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.485821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:32.486119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.487503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c58caa-996c-4f10-b0cf-e299ec1de6d8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.494069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 476/959] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:32.500503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:32.615657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925058ac-3631-4fd9-a3d8-1066f2f11de2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:32.651562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:32.652176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:32.652469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:32.652729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:32.653452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:32.653749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:32.655110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f4d21-6a5c-4c78-87a7-a6b650861fcf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:32.660518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 484/960] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:33.002640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835506a7-60b5-49ac-a778-82836694e9ec None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:33.003031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835506a7-60b5-49ac-a778-82836694e9ec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:33.003207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835506a7-60b5-49ac-a778-82836694e9ec None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:33.005132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 477/961] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:33.010409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:33.010701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:33.010977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:33.030578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:33.032136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:33.056860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:33.107904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 485/962] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:33.127726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835506a7-60b5-49ac-a778-82836694e9ec None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:33.132010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:33.237697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835506a7-60b5-49ac-a778-82836694e9ec None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:33.271536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:33.272142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:33.272435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:33.272703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:33.273337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:33.274751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:33.277284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING keystone.server.flask.common [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 12:10:33.293352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.sql.core [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 12:10:33.293352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 12:10:33.293352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [parameters: {'user_id': '83fc215e8fa048b394367867e1fbf040', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 12:10:33.293352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:33.300226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:33.301230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application yield resource Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application next(self.gen) Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise self.value Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application session.commit() Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 12:10:33.302225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.session.flush() Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application compat.raise_( Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 12:10:33.303130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 12:10:33.305506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application conn.query(q) Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application result.read() Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 12:10:33.307275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [parameters: {'user_id': '83fc215e8fa048b394367867e1fbf040', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:33.316840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 12:10:33.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:33.319953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 478/963] 10.222.0.60 () {60 vars in 1131 bytes} [Tue Aug 9 12:10:33 2022] POST /identity/v3/users => generated 160 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:33.320692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:33.408734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac989346-7357-4b8e-bdbe-824a2a92b419 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:33.443976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:33.444635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:33.444906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:33.445171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:33.452653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:33.454164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-dd556961-3096-45fc-8bdd-229d4aa81c6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:33.470919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:33.473288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:33.475477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 486/964] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:33.480408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:33.549878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:33.588848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48d161-43c5-409f-b243-725264aa138e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:33.623845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:33.624800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:33.625240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:33.625652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:33.626486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:33.626922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:33.628909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6368a7e-eb17-4fbf-a210-1d0454d2f723 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:33.667552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 479/965] 10.222.0.60 () {56 vars in 1101 bytes} [Tue Aug 9 12:10:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:34.376172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ca451-a814-4351-b512-3af0e5492bbd None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.376948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ca451-a814-4351-b512-3af0e5492bbd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.376948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ca451-a814-4351-b512-3af0e5492bbd None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.378183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 487/966] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:34.384232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.384510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.384813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.404295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:34.405820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:34.447173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eef2c-d9fe-4806-8750-1b51bb5cc101 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.447805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eef2c-d9fe-4806-8750-1b51bb5cc101 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.448299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52eef2c-d9fe-4806-8750-1b51bb5cc101 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.449894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 488/967] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:34.455289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.455896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.456559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.477059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:34.478253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:34.480681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 480/968] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:34.493684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:34.501579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:34.548962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 489/969] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:34.567362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:34.571120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:34.615770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f41e-4d1e-46db-a01d-1fff080181f2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:34.657469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:34.658120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.658394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.658790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.670710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:34.675731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:34.676814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:34.677670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:34.678342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9ef4d-9b70-48a6-8c6f-7a4cb5982318 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:34.682663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 481/970] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:34.683536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:34.713620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:34.714257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.714535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.714784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.715382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:34.716757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:34.725890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:34.726958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:34.729436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 490/971] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:34.733103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:34.749172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:34.789134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e71c93-0011-4006-8d2d-5bd1d10ba59e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:34.803809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:34.824761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:34.825371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.825645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.825909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.826567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:34.826865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:34.828307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75387542-881c-4dad-bf85-09aa5de2eb58 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:34.832840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa802bf3-4708-4bd3-9419-b0dc2abaa6d2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:34.836236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 482/972] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:34.837491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51007c5-64b1-4588-9768-9c4f4140b1d1 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.837780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51007c5-64b1-4588-9768-9c4f4140b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.838052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51007c5-64b1-4588-9768-9c4f4140b1d1 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.839391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 483/973] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:34.841798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51007c5-64b1-4588-9768-9c4f4140b1d1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:34.868929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:34.869667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.870029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.870364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.870991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:34.871294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:34.872698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cd4a0-ec51-4cce-817d-8e59a5370889 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:34.877414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 491/974] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:34.878530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.878797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.879069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.902234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:34.903430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:34.945101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51007c5-64b1-4588-9768-9c4f4140b1d1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:34.970063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 492/975] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:34.970821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:34.980488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:34.985953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:34.986660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:34.987003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:34.987319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:34.998499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:34.999965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:35.013604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:35.014771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:35.020990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:35.020990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:35.020990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:35.020990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 484/976] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:35.020990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.047851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.077223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9835a4-319a-4123-ad73-4302a29f15b4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.111854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.112508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.112790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.113058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.113689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:35.113983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.115355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.119818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8cf6b-6a81-4acb-9df2-cc4b080f819c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.120092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 493/977] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:35.120882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.154528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.155140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.155412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.155689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.156324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.157718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.173275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 485/978] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:35 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:35.174075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.212212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.249827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce59e2-bb6d-4764-8714-ca95f34c2da6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.280176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.298992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.299458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.299732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.299999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.300678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:35.300976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.302361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.304496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b99180-a607-4af3-996d-7e752e219090 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.319736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 494/979] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:35.320958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.349846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.351418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.351418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.351418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.352414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] RBAC: Adding query filter params (interface=admin, service_id=bc19ef5c528448ef9404889ae0fd8789, region_id=RegionOne) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:35.352414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.353790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.360690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 486/980] 10.222.0.60 () {56 vars in 1249 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/endpoints?service_id=bc19ef5c528448ef9404889ae0fd8789&interface=admin®ion_id=RegionOne => generated 193 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:35.366597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.433934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9380d-6bee-4835-b95e-68c42307893f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.461940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.470215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d1103-2d63-435c-89ae-963ddeb497b9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.471252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.472148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.472447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.472756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.482624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.484068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:35.495840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:35.496975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:35.497938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 495/981] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:35.502832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.510448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.511070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.511346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.511615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.512221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.513622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.528669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 487/982] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:10:35.623777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fc51b-93e9-4ca3-beb2-9ce6eca1b685 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.661229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.661919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.662202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.662472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.663217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:35.663589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.665081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.687728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 496/983] 10.222.0.60 () {56 vars in 1149 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:35.693706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:35.714244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:35.803579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68964dc6-1702-4f51-9c40-e4e0e0dca462 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:35.838990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:35.839596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:35.839872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:35.840137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:35.919300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:35.920783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:35.935287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:36.029157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 488/984] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:35 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:36.040742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:36.090084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:36.145157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb2bad-0f8a-4054-a53a-67ca807a1ad6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:36.180048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:36.180689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:36.180960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:36.181223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:36.191176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:36.192661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:36.206710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:36.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:36.208691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:36.208691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:36.208691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:36.208691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 497/985] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:36.214926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:36.321925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7f4ad-8919-4787-95ab-866035fce173 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:36.336306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:36.358516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:36.359038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:36.359308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:36.359579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:36.360197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:36.360525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:36.361881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:36.373392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 489/986] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:36.378850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:36.474592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:36.479434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74150238-523d-4f6d-a5e6-08f278d4526b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:36.513144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:36.513768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:36.514038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:36.514300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:36.521266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:36.522674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:36.534292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:36.535367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:36.536316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:36.537496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 498/987] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:36.541385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:36.649653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73978f51-6121-4bed-867b-b4d0842f5a9c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:36.683704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:36.684306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:36.684603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:36.684865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:36.685545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:36.685900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:36.687333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aabd7-2bc7-4bb0-b1b1-cd940ab4d9de None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:36.699603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 490/988] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:36.705560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:36.803571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283097f5-84ae-4679-8c09-9b4b75672bbb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:36.836436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:36.837049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:36.837320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:36.837579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:36.838294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] RBAC: Adding query filter params (role.id=db1890d2d345456582075dae63d0a3cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=8ea2a62cdced4ef3b68868101b3c3dae) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:36.838593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:36.839988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75978c4-3b49-4c31-a77b-e7814bd559e0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:36.845845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 499/989] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:36 2022] GET /identity/v3/role_assignments?user.id=8ea2a62cdced4ef3b68868101b3c3dae&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=db1890d2d345456582075dae63d0a3cf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:37.207373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d59c1-5ef3-4a2f-9d77-5dab580f0a6c None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.207748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d59c1-5ef3-4a2f-9d77-5dab580f0a6c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.208013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d59c1-5ef3-4a2f-9d77-5dab580f0a6c None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.209430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 491/990] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:37.214807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.215067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.215369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.233671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:37.234866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:37.252201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:37.303850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 500/991] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:37.325449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d59c1-5ef3-4a2f-9d77-5dab580f0a6c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:37.358394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:37.430432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d59c1-5ef3-4a2f-9d77-5dab580f0a6c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:37.465883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:37.466422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.466687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.466943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.467537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:37.468922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f04954e7-8751-415a-95bf-25d357dccd5c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:37.477598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:37.478597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:37.479455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 492/992] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:37.484814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:37.564593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1401c-b871-47fe-ab82-e5061b6dee07 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.565174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1401c-b871-47fe-ab82-e5061b6dee07 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.565174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1401c-b871-47fe-ab82-e5061b6dee07 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.566841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 493/993] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:37.572225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.572691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.573119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.589142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9a405-2072-4aaf-b8bf-75bf5b15b70a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:37.592771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:37.594066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:37.629535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203d533-8624-4907-904b-5153966e69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:37.630128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d533-8624-4907-904b-5153966e69fb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.630400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d533-8624-4907-904b-5153966e69fb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.630656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203d533-8624-4907-904b-5153966e69fb None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.631336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203d533-8624-4907-904b-5153966e69fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:37.631796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203d533-8624-4907-904b-5153966e69fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:37.634034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5203d533-8624-4907-904b-5153966e69fb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:37.644202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 501/994] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:37.645270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203d533-8624-4907-904b-5153966e69fb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:37.664805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 494/995] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:37.666863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:37.687430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:37.714559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:37.776548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203d533-8624-4907-904b-5153966e69fb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:37.790772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152bf1a-1cfc-4d17-be2e-521fd33edfb9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:37.814325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:37.815061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.815372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.815873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.818258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:37.818573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:37.819963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:37.833605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 502/996] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:37.834716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:37.834841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:37.835376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:37.835652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:37.835918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:37.836545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:37.837990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:37.848360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:37.849635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 12:10:37.850677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:37.854607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 495/997] 10.222.0.60 () {56 vars in 1126 bytes} [Tue Aug 9 12:10:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:37.855675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:37.939923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:37.960180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:37.966997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43b0c9-c712-4117-8268-373522a621c8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:37.973512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed037ba-5498-4d8d-9762-a2a7131ff01e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.012928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.013513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.013808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.014061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.014766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] RBAC: Adding query filter params (interface=public, service_id=8c80f39b575544ad93678396fda3e034, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:38.015399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.016811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.021576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.022474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 503/998] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:37 2022] GET /identity/v3/endpoints?service_id=8c80f39b575544ad93678396fda3e034&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:38.022611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.023045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.023308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.023944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:38.024241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.025728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.028980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.038475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 496/999] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:38.040060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.152406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f357a0d-05b3-45c8-b26e-86a4d06aa8a6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.177110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a35c9e-0fa8-4efe-be4d-ac34ec2b25a9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.190878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.191705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.191988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.192260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.192906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.194312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.201485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 504/1000] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:38 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:10:38.232130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bea37-b270-4333-95a1-275e2938acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.232797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bea37-b270-4333-95a1-275e2938acda None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.233073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bea37-b270-4333-95a1-275e2938acda None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.233470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bea37-b270-4333-95a1-275e2938acda None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.234617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bea37-b270-4333-95a1-275e2938acda None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:38.235055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bea37-b270-4333-95a1-275e2938acda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.236860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bea37-b270-4333-95a1-275e2938acda None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.248756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 497/1001] 10.222.0.60 () {56 vars in 1122 bytes} [Tue Aug 9 12:10:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:38.250975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:38.263674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:38.402478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d5d1-877b-43ff-bb51-2ea8dd68ebcb None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:38.440142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47acb5db-fc98-4e2e-8940-80e7128fdf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:38.441550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acb5db-fc98-4e2e-8940-80e7128fdf6b None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.442061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acb5db-fc98-4e2e-8940-80e7128fdf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.442477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acb5db-fc98-4e2e-8940-80e7128fdf6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.443307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acb5db-fc98-4e2e-8940-80e7128fdf6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:38.444863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47acb5db-fc98-4e2e-8940-80e7128fdf6b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:38.465985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 505/1002] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:38.904909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d7d5-33e1-41e4-a041-b08225a94358 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.905438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d7d5-33e1-41e4-a041-b08225a94358 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.905693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d7d5-33e1-41e4-a041-b08225a94358 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.907083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 498/1003] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:38.912662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:38.913100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:38.913177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:38.935919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:38.937525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:39.009872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:39.027097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 506/1004] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:39.044826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d7d5-33e1-41e4-a041-b08225a94358 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:39.066807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:39.152367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690d7d5-33e1-41e4-a041-b08225a94358 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:39.186453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:39.187123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:39.187404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:39.187676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:39.188260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:39.189659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:39.198992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:39.200002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:39.200908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:39.204728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 499/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Aug 9 12:10:39 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:39.206128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:39.309931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97188b-e554-456f-b0bb-e0aa1e65c1c9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:39.343618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6314d50-e356-469b-8639-b655450e432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:39.344223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314d50-e356-469b-8639-b655450e432b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:39.344521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314d50-e356-469b-8639-b655450e432b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:39.344790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6314d50-e356-469b-8639-b655450e432b None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:39.345410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314d50-e356-469b-8639-b655450e432b None admin] RBAC: Adding query filter params (name=image) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:39.345707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314d50-e356-469b-8639-b655450e432b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:39.347068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6314d50-e356-469b-8639-b655450e432b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:39.352072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 507/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:39.357660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:39.445573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:39.465757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36670d-bb33-45db-b894-ee0ef84ad1b1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:39.500793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:39.501393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:39.501665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:39.501926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:39.502544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] RBAC: Adding query filter params (type=image) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:39.502843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:39.504262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20def509-5ef0-4c67-9441-1e79f62de712 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:39.509415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 500/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:40.345550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d63f7-70be-4fd1-8118-891a8ef6e171 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.346137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d63f7-70be-4fd1-8118-891a8ef6e171 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.346137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d63f7-70be-4fd1-8118-891a8ef6e171 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.347744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 508/1008] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:40.353629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f1db-1e26-41ef-8a08-6a9d63d01608 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.354067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f1db-1e26-41ef-8a08-6a9d63d01608 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.354166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f1db-1e26-41ef-8a08-6a9d63d01608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.373243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-bf55f1db-1e26-41ef-8a08-6a9d63d01608 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:40.374418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bf55f1db-1e26-41ef-8a08-6a9d63d01608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:40.445735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 501/1009] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:40.468599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d63f7-70be-4fd1-8118-891a8ef6e171 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:40.487138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a21c-e18d-4135-8f8e-6179f32428d3 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.487378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a21c-e18d-4135-8f8e-6179f32428d3 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.487669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685a21c-e18d-4135-8f8e-6179f32428d3 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.489728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 502/1010] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:40.494570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.494839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.495095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.520233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:40.521442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:40.537550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:40.581062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d63f7-70be-4fd1-8118-891a8ef6e171 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:40.591643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 503/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:40.617374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:40.619328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:40.619962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.620231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.620536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.621114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:40.622466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:40.626167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:40.632434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:40.633457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:40.634303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 509/1012] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:40.639451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:40.725272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88d95c-5a35-4ab0-9f5b-7b9c03dff881 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:40.743849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56795d7b-bc52-43b5-aac0-7f85eb44de11 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:40.762530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:40.763158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.763432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.763690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.764803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:40.766563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:40.767202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:40.768134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 504/1013] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:40.774538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:40.779638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:40.780242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.780557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.780821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.781444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:40.781737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:40.783070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:40.792463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 510/1014] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:40.793464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:40.852336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:40.879651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb6310-81b8-4537-83dd-9014778d3d9e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:40.915957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2f2d3-ee2f-48f1-9a64-4c87b344a8a4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:40.918267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:40.918942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.919284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.919550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.920191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:40.921642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:40.952407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 505/1015] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:40 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:40.964766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:40.965511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:40.965852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:40.966185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:40.966902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:40.967285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:40.968803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822488f-71cb-4f2d-9c48-57173bf6b3e1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:40.975552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 511/1016] 10.222.0.60 () {56 vars in 1112 bytes} [Tue Aug 9 12:10:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:40.981572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:41.090781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5424c-d6ca-4595-8131-a1b4b1b5e61c None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:41.117642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:41.127613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e9c7d-51aa-4955-8f87-49d147f09630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:41.128208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e9c7d-51aa-4955-8f87-49d147f09630 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.128510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e9c7d-51aa-4955-8f87-49d147f09630 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.128850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e9c7d-51aa-4955-8f87-49d147f09630 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.129513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e9c7d-51aa-4955-8f87-49d147f09630 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:41.130931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e9c7d-51aa-4955-8f87-49d147f09630 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:41.152942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 506/1017] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:41.493717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0753-2998-47a6-9225-4a437c6aa9e2 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.494259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0753-2998-47a6-9225-4a437c6aa9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.494259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0753-2998-47a6-9225-4a437c6aa9e2 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.495679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 512/1018] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:41.501131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b4bda-dc35-4a35-95ab-687f63f53697 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.501563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b4bda-dc35-4a35-95ab-687f63f53697 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.501642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b4bda-dc35-4a35-95ab-687f63f53697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.521338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-280b4bda-dc35-4a35-95ab-687f63f53697 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:41.522516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-280b4bda-dc35-4a35-95ab-687f63f53697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:41.597413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 507/1019] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:41 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:41.620030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0753-2998-47a6-9225-4a437c6aa9e2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:41.672172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:41.725296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0753-2998-47a6-9225-4a437c6aa9e2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:41.761362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b780-8b27-4f87-aa01-1a2ec9d5be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:41.761875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b780-8b27-4f87-aa01-1a2ec9d5be4d None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:41.762149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b780-8b27-4f87-aa01-1a2ec9d5be4d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:41.762414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b780-8b27-4f87-aa01-1a2ec9d5be4d None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:41.763058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b780-8b27-4f87-aa01-1a2ec9d5be4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:41.764425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b780-8b27-4f87-aa01-1a2ec9d5be4d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:41.780777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 513/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:10:41 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:42.982376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2faa0-8a4b-473a-9ef9-6fd49c70a0fe None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:42.982931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2faa0-8a4b-473a-9ef9-6fd49c70a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:42.982931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2faa0-8a4b-473a-9ef9-6fd49c70a0fe None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:42.984294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 508/1021] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:42.989651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfaf36-e8df-47cf-a682-d7aa9bc808c2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:42.990072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfaf36-e8df-47cf-a682-d7aa9bc808c2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:42.990150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bfaf36-e8df-47cf-a682-d7aa9bc808c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.008334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-53bfaf36-e8df-47cf-a682-d7aa9bc808c2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:43.009543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53bfaf36-e8df-47cf-a682-d7aa9bc808c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:43.084765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 514/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:43.108795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2faa0-8a4b-473a-9ef9-6fd49c70a0fe None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.213996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2faa0-8a4b-473a-9ef9-6fd49c70a0fe None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:43.223641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:43.241553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7f88-ae9d-4231-9c77-194dd181bfb6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.241883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7f88-ae9d-4231-9c77-194dd181bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.242081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7f88-ae9d-4231-9c77-194dd181bfb6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.243432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 515/1023] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:43.248208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.248514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.248780 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.251510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:43.252303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.252741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.253146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.254448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:43.256039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:43.257672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 509/1024] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:43.263285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.267652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:43.268857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:43.297824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:43.342292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 516/1025] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:43.365117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.373604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a81064-eb82-46d4-936a-5d4bfbdecf25 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:43.410515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:43.411118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.411386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.411646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.412279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:43.413725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:43.438153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 510/1026] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:10:43 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:10:43.477109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc5de5-6508-4111-b366-deea35fc373e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:43.517467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:43.518513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.519004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.519569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.532210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:43.537807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:43.539057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:43.540089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:43.542225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 517/1027] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:43.548808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.585178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:43.663208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663834-ea60-405e-8304-3dcf4e5d8b5e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:43.700143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:43.700862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.701139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.701429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.702094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:43.702394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:43.703765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da1fd1-8b0f-4677-bc7e-3b3f054c18b7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:43.712851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 511/1028] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:43.718488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.748059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:43.775059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f1f21-6ed5-475c-9ed5-1a87eb115f5b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.775341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f1f21-6ed5-475c-9ed5-1a87eb115f5b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.775616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f1f21-6ed5-475c-9ed5-1a87eb115f5b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.777040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 512/1029] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:43.782054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.782340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.782609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.800699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:43.801868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:43.830745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfed4a-caa7-4482-a2df-5a0372d51507 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:43.868011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:43.868656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:43.868929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:43.869192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:43.871996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 513/1030] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:43.880073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:43.883836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:43.897910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:43.901903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:43.903027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:43.904192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:43.904192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:43.904192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:43.904192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 518/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:43.908617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:43.926602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:43.992260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.006614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ada72-9f57-4296-aaca-e8485009fad7 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.015680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9daa5-bfb3-43ff-935b-1a4f4c80ea0f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.044799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.045529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.045801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.046200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] PATH_INFO: `/v3/services/image` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.046762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.048152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.050837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.051474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.051751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.052021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.052692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:44.052992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.054339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:44.058075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:44.059243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:44.060263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:44.062721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 514/1032] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:44.068449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.071063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 519/1033] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:44.076665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.161615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.173982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a195758-e8fc-4789-8319-3b230f133d56 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.183401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1d4fc-f242-44e1-9b5c-027387d39c42 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.208092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.208734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.209008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.209345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.209892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] RBAC: Adding query filter params (name=image) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:44.210189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.211552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.217108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 515/1034] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:44.219580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.220215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.220513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.220783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.222739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.228686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.230120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.231918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:44.242761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:44.243793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:44.244785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 520/1035] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:44.249475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.327591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba0be66-20b9-4b69-8379-e67b73e230ae None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.350731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfca788-9775-44fa-aa37-e73b80dfd6a8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.359736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.360347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.360653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.360921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.361551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:44.361854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.363271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.368462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 516/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:44.374241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.385083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.385692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.385968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.386235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.386956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:44.387263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.388713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.394011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.411831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 521/1037] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:44.417325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.474157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.478751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66f80d-1fc5-48e3-a75b-5da83131c2a3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.511900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.512538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.513188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.513464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.514159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] RBAC: Adding query filter params (interface=public, service_id=fd1776af44c8437388a7250cf4c58a48, region_id=RegionOne) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:44.514464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.516154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.520071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed75c4-ce06-47f8-a772-cfe2b6d33bf9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.521419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 517/1038] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/endpoints?service_id=fd1776af44c8437388a7250cf4c58a48&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:44.526673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.555268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.555901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.556156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.556450 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.609337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.629015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456f729-a283-4875-872d-cee62c4bcba7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.635160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.637057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.664084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.664726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.665001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.665267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.665957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.667328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.673943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 518/1039] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:10:44.699464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.747404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 522/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:44.753607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:44.867226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3007-1a7f-4559-b33c-5b1d2a7085ab None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:44.908850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:44.909490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:44.909943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:44.910220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:44.921220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:44.922672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:44.925531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:44.938069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:44.939057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:44.939969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:44.939969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:44.939969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:44.939969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 519/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:44.945536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:45.049948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cec18-9074-4fb8-9c96-c9da4bb0c8aa None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:45.084288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:45.084920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.085196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.085462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.086105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:45.086404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:45.087773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:45.100035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 523/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:45.105587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:45.215599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea07b9-43bd-4873-bf40-5f81937950ec None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:45.250312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:45.250937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.251207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.251466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.258641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:45.260084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:45.271654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:45.272908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:45.273826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 520/1043] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:45.280525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:45.299027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:45.384108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11e352-297c-40a1-8c50-73354321b9b1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:45.418240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:45.418839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.419111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.419378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.420061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:45.420360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:45.421817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc485-8510-428d-8587-a3d22dac3b65 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:45.438712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 524/1044] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:45.439982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:45.489274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aa576-6ada-416e-b96f-206494b5829e None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.489483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aa576-6ada-416e-b96f-206494b5829e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.489726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aa576-6ada-416e-b96f-206494b5829e None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.491091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 525/1045] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:45.496100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.496354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.496673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.502384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:45.516231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:45.517468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:45.552002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ae10e-668b-483c-9381-1eb2e6e8e440 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:45.585613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 526/1046] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:45.588846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:45.589451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.589747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.589987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.590699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] RBAC: Adding query filter params (role.id=db1890d2d345456582075dae63d0a3cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=2d6406240f104443b75c8ec7d7999070) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:45.590999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:45.592466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:45.598788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 521/1047] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:45 2022] GET /identity/v3/role_assignments?user.id=2d6406240f104443b75c8ec7d7999070&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=db1890d2d345456582075dae63d0a3cf => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:45.608953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:45.618651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:45.720396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102a252-3273-470a-8ac4-b10da3756f8b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:45.757621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:45.758258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.758532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.758812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.770215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:45.775001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:45.775914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:45.777219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:45.780640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 527/1048] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:45.782290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:45.895240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d187165-88ae-4938-b55d-4bda16f30ae3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:45.916403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:45.931672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:45.932280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:45.932586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:45.932850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:45.933508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:45.933801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:45.935157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:45.944713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 522/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:45.950428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.023639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:46.061865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd14a5-749c-4756-acf5-8b9016292517 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.095618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.096237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.096534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.096798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] PATH_INFO: `/v3/users/ff9b36103d4b4e299ccc192b1d9b0634` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.111046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] RBAC: Authorizing `identity:get_user(user_id=ff9b36103d4b4e299ccc192b1d9b0634)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.112575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:46.114960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 528/1050] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:45 2022] GET /identity/v3/users/ff9b36103d4b4e299ccc192b1d9b0634 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:46.120650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.230843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb8494-53b6-4960-86a3-fb1f85f0a523 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.268415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.269142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.269651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.270334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.321850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:46.342434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.343879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:46.451294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 523/1051] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:46.452949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.557101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705ba80-209e-4fb4-8012-c3ebb16f05bf None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.582527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:46.595023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a2552-bc6f-4208-898e-9e8bdfc295ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.595645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2552-bc6f-4208-898e-9e8bdfc295ed None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.595918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2552-bc6f-4208-898e-9e8bdfc295ed None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.596193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a2552-bc6f-4208-898e-9e8bdfc295ed None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.597483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a2552-bc6f-4208-898e-9e8bdfc295ed None admin] RBAC: Authorizing `identity:get_project(project_id=74dd22b318574a0d96e86773e138ec4d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.599101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a2552-bc6f-4208-898e-9e8bdfc295ed None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:46.606110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 529/1052] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:46 2022] GET /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:46.607703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.698869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:46.716284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7554-addc-4c2e-a63e-7ae273e5a3bd None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.716589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7554-addc-4c2e-a63e-7ae273e5a3bd None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.716855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b7554-addc-4c2e-a63e-7ae273e5a3bd None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.718206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 530/1053] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:46.723020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.723300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.723568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.724537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716074e5-0441-4618-a56d-2f08f6d2bb7a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.744246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:46.745519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:46.760674 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.761284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.761555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.761817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.762541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=74dd22b318574a0d96e86773e138ec4d, user.id=ff9b36103d4b4e299ccc192b1d9b0634) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:46.762844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.764259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:46.770051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 524/1054] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:46 2022] GET /identity/v3/role_assignments?user.id=ff9b36103d4b4e299ccc192b1d9b0634&scope.project.id=74dd22b318574a0d96e86773e138ec4d&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:46.818819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 531/1055] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:46.841487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:46.960012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb20a-e415-449a-8b57-761ccae7e4fc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:46.994278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:46.994920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:46.995165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:46.995444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] PATH_INFO: `/v3/services/image` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:46.996025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:46.997584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:47.006465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:47.007479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:47.008970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 525/1056] 10.222.0.60 () {56 vars in 1105 bytes} [Tue Aug 9 12:10:46 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:47.013738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:47.120864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077bf3b-b8f9-4f13-8443-6b43fa5aee8b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:47.144844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:47.157565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:47.158175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:47.158454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:47.158720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:47.159348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] RBAC: Adding query filter params (name=image) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:47.159717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:47.161583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:47.167017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 532/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:47.175175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:47.189579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:47.289750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236de06-5b0c-422b-8e4d-47dd54224169 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:47.325034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:47.325640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:47.325913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:47.326177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:47.326799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] RBAC: Adding query filter params (type=image) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:47.327100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:47.328492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f8fd5-7d14-48c9-8919-266992fd1b5c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:47.334192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 526/1058] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:47.339898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:47.449093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec408655-3b73-4073-8208-a157f7a06895 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:47.486808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7676f-0ecb-488e-a44c-8f6f76cbd4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:47.487412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7676f-0ecb-488e-a44c-8f6f76cbd4f0 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:47.487685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7676f-0ecb-488e-a44c-8f6f76cbd4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:47.488451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7676f-0ecb-488e-a44c-8f6f76cbd4f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:47.488784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7676f-0ecb-488e-a44c-8f6f76cbd4f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:47.490144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7676f-0ecb-488e-a44c-8f6f76cbd4f0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:47.512737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 533/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:10:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:47.558337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeddc6e-2d05-4e46-8f34-90036e9ee949 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:47.558710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeddc6e-2d05-4e46-8f34-90036e9ee949 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:47.558836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeddc6e-2d05-4e46-8f34-90036e9ee949 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:47.560414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 527/1060] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:47.567112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:47.567448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:47.567675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:47.589273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:47.590622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:47.635019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:47.683613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 534/1061] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:47.705720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeddc6e-2d05-4e46-8f34-90036e9ee949 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:47.790426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:47.817324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeddc6e-2d05-4e46-8f34-90036e9ee949 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:47.856185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:47.856897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:47.857139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:47.857441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:47.870621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:47.875396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:47.876702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:47.877572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 528/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:47.885043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:47.988849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0de2af-700a-4dc8-bbdd-cd26a9f975ce None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.024001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.024732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.025002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.025265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.025923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:48.026217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:48.027570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:48.036101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 535/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:48.042184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.142559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5117d6-4a44-4b77-b098-9848ddc7fff7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.176505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.177182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.177446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.177633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.180365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:48.190586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:48.192344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:48.206477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:48.207554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:48.208539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:48.208539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:48.208539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:48.208539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 529/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:48.214840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.248906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:48.323382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935fc280-f840-4427-afba-e282eeec9089 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.357946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.358556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.358838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.359109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.359739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:48.360049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:48.361445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:48.373767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 536/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:48.379332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.486186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18008-897f-4ae9-aaf5-e975f7118ea8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.521391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.521942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.522218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.522483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.530299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:48.531740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:48.543064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:48.544014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:48.545028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 530/1066] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:48.551883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.644236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:48.656465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af10fb-bb1f-46c7-9f56-faeb94be3cb7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.691727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.692330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.692641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.692910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.693636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:48.693950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:48.695357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8a0ec-2bed-4cc4-89f9-e6ef2dc41b98 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:48.712972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 537/1067] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:48.718583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.748563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d620b50-5800-46aa-8807-4de58d880907 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.748879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d620b50-5800-46aa-8807-4de58d880907 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.749090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d620b50-5800-46aa-8807-4de58d880907 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.750690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 538/1068] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:10:48.755484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.755761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.756028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.766933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:48.774992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:48.776049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:48.829810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79981666-770f-452a-877a-fc797a27eb29 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:48.847776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 539/1069] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:10:48.865570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:48.866279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:48.866554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:48.866818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:48.869353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.877465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:48.879302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:48.899991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:48.901082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:48.902002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:48.902002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:48.902002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:48.902002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 531/1070] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:48.906734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:48.958316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:48.981842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35211000-6751-4aa9-9151-64b926b2bcc5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.007868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.011887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66c7d3-d44c-4465-b0d1-0fc55eb7c0a5 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.019804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.020469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.020745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.021012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.032238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:49.036928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:49.037942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:49.038773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 540/1071] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:49.043846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.050172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.050836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.051107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.051371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.052006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:49.052304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.053711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.070336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 532/1072] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:49.071367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.151823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f053ed-55cf-4765-b8ab-a4aeb68f3438 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.171822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11361fa1-b10e-47e3-83d8-35982a284eff None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.186350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.187282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.187610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.187879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.188570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:49.188870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.190223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.195521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.200296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 541/1073] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:49.205690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.213615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.214805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.215244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.215657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.223323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.224788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:49.236640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:49.237849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:49.238854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 533/1074] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:49.243539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.262847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.316154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa2b9d-33c3-44d5-a7b1-cce25c91a2b1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.350838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.351459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.351731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.351993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] PATH_INFO: `/v3/users/ff9b36103d4b4e299ccc192b1d9b0634` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.352549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86283cdc-d98a-4351-a98e-1f360307c946 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.353170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] RBAC: Authorizing `identity:get_user(user_id=ff9b36103d4b4e299ccc192b1d9b0634)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.354584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.360858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 542/1075] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/users/ff9b36103d4b4e299ccc192b1d9b0634 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:49.361677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.389675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.390631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.390905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.391167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.391848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:49.392146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.393636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.413085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 534/1076] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:49.414898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.428059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.463752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da429737-873f-49f9-aaf4-ca4de32e7dbd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.499476 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.500095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.500368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.501719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.502882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] RBAC: Authorizing `identity:get_project(project_id=74dd22b318574a0d96e86773e138ec4d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.504546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.506821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 543/1077] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:49.510182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.512651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.538471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0fdc0-a049-4ae4-9f06-3bd513e632dd None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.572488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e371d-5b98-4197-a5e5-b82752742734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.573078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e371d-5b98-4197-a5e5-b82752742734 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.573351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e371d-5b98-4197-a5e5-b82752742734 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.573618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e371d-5b98-4197-a5e5-b82752742734 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/2d6406240f104443b75c8ec7d7999070/roles/db1890d2d345456582075dae63d0a3cf` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.575744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e371d-5b98-4197-a5e5-b82752742734 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=2d6406240f104443b75c8ec7d7999070, role_id=db1890d2d345456582075dae63d0a3cf)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.577212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e371d-5b98-4197-a5e5-b82752742734 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.590292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 535/1078] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:49 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/2d6406240f104443b75c8ec7d7999070/roles/db1890d2d345456582075dae63d0a3cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:10:49.591499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266fcd-ff2f-40ff-9b71-2d6be11bdf38 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.591747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266fcd-ff2f-40ff-9b71-2d6be11bdf38 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.592013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266fcd-ff2f-40ff-9b71-2d6be11bdf38 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.593278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 536/1079] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:49.599215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.599693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.600073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.618984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc513d-676c-402f-ac18-ef7d139199b4 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.620718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:49.621957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:49.663931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.664484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.664765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.665037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d/users/ff9b36103d4b4e299ccc192b1d9b0634/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.667047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] RBAC: Authorizing `identity:create_grant(project_id=74dd22b318574a0d96e86773e138ec4d, user_id=ff9b36103d4b4e299ccc192b1d9b0634, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.668543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:49.671919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.691544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 544/1080] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:10:49 2022] PUT /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d/users/ff9b36103d4b4e299ccc192b1d9b0634/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:10:49.718927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 537/1081] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:49.741642 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:49.855569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab45ad-fbd6-417e-b992-6d28670f5a25 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:49.894758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:49.895404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:49.895677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:49.896052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:49.960772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:49.968855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:49.970328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:50.076471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 545/1082] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:50.082416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:50.150350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:50.194065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06692fbf-2494-483a-897b-f6c94f874f1e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:50.229830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:50.230474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:50.230698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:50.230996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:50.241823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:50.243341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-2adb6f6d-efe9-4f41-88f8-cfbb89db1c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:50.259187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:50.260237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:50.261735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:50.261735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:50.261735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:50.268448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 538/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:50.268677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:50.369327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:50.377034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b89cf-c24d-4fcd-93b8-50c3b4c2548f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:50.415364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:50.415871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:50.416157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:50.416424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:50.417082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:50.417383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:50.418756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c482aba-6e80-4ab5-9ded-9b6d4dd7013c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:50.430542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 546/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:51.584253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43802f-5dfc-4813-b1ed-982a0bad0831 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.584825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43802f-5dfc-4813-b1ed-982a0bad0831 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.584825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43802f-5dfc-4813-b1ed-982a0bad0831 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.586173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 539/1085] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:51.591815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b9164-69f6-40c2-b3e6-4fe642ce17b5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.592214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b9164-69f6-40c2-b3e6-4fe642ce17b5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.592408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b9164-69f6-40c2-b3e6-4fe642ce17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.612609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f24b9164-69f6-40c2-b3e6-4fe642ce17b5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:51.613825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f24b9164-69f6-40c2-b3e6-4fe642ce17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:51.684719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 547/1086] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:51.690008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d4c3-a9cb-4cfd-bdf7-9acc3cfb970b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.690288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d4c3-a9cb-4cfd-bdf7-9acc3cfb970b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.690552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9d4c3-a9cb-4cfd-bdf7-9acc3cfb970b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.692103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 540/1087] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:51.697025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30048-727e-428c-bde3-7c278992f70c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.697307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30048-727e-428c-bde3-7c278992f70c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.697571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf30048-727e-428c-bde3-7c278992f70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.708209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9d4c3-a9cb-4cfd-bdf7-9acc3cfb970b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:51.716298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-edf30048-727e-428c-bde3-7c278992f70c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:51.717512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-edf30048-727e-428c-bde3-7c278992f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:51.783415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 548/1088] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:51.808766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30048-727e-428c-bde3-7c278992f70c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:51.811315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9d4c3-a9cb-4cfd-bdf7-9acc3cfb970b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:51.826884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:51.833838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:51.850172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:51.850762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.851037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.851299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.862043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:51.867311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:51.868233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:51.869330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 541/1089] 10.222.0.60 () {56 vars in 1120 bytes} [Tue Aug 9 12:10:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:51.874456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:51.913130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf30048-727e-428c-bde3-7c278992f70c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:51.947702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:51.948354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:51.948646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:51.948937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:51.959007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:10:51.963623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:51.964753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:51.965616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 549/1090] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:51.971026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:51.974381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a0a1-e8a8-4f58-8c28-69fc81f2b762 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.007390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.007993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.008262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.008549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.009205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:52.009519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.010873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.018913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 542/1091] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:10:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:52.024820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.050290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.067526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.074133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2b7d0-1824-4447-ad16-b728499ba0d2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.109068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.109662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.109933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.110198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.110850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:52.111146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.112556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.120820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 550/1092] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.124600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e061-5dea-4a79-a6dc-d4bbe9c249ca None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.126712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.157982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.158611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.158882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.159146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.169295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.170731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:52.184631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:52.185638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:52.186590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:52.186590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:52.186590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:52.186590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 543/1093] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:52.191798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.227591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59200abf-395d-4b0b-9e29-1bb47ed4ed78 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.259330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.259948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.260219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.260511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] PATH_INFO: `/v3/users/ff9b36103d4b4e299ccc192b1d9b0634` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.261612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9b36103d4b4e299ccc192b1d9b0634)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.263047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.264678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 551/1094] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/users/ff9b36103d4b4e299ccc192b1d9b0634 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.270859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.280050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.286830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.293632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc098ca4-c39f-4c5e-bc5b-2ddc99445022 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.327346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.327945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.328216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.328507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.329137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:52.329431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.330788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.342402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 544/1095] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.348348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.371199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23459-04d7-47bf-8fe6-c074e4254311 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.405246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.405847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.406114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.406376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.442744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a98b3-e498-4e62-838a-b7577293c000 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.470766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.472277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.476725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.477355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.477633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.477897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.480083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.485407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.486910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:10:52.498459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:52.499480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:10:52.500499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 545/1096] 10.222.0.60 () {56 vars in 1093 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:10:52.505549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.521754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.575828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 552/1097] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:52.581711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.604023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105adcd-2427-4700-ad2d-9a9a9ac1333b None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.638782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.639469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.639741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.640350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.641097 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:52.641393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.642809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.660009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 546/1098] 10.222.0.60 () {56 vars in 1133 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:52.665903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.685831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b7989-c000-4b1b-bbfb-6ed978d57aca None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.693068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.719670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.720293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.720597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.720862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.721974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] RBAC: Authorizing `identity:get_project(project_id=74dd22b318574a0d96e86773e138ec4d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.723430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.725096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 553/1099] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.731399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:52.739143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.770239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e007a-0507-49f6-89df-26290e090fa2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.804296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.804922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.805195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.805457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.829093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892537b-073f-48e4-aa1d-b8c79a8f998a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:52.865724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:52.866303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:52.866572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:52.866833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:52.867544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=74dd22b318574a0d96e86773e138ec4d, user.id=ff9b36103d4b4e299ccc192b1d9b0634) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:52.867841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.869279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.870568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:52.871993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:52.874897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 554/1100] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/role_assignments?user.id=ff9b36103d4b4e299ccc192b1d9b0634&scope.project.id=74dd22b318574a0d96e86773e138ec4d&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:52.954263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:52.988842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 547/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 12:10:52.994891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:53.040994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:53.100830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03dcc8-68fe-42d4-b79b-65e97957cfd7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:53.136410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:53.137039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:53.137310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:53.137576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:53.148254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:53.149720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:10:53.164180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:53.165376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:10:53.166318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:10:53.166318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:10:53.166318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:53.166318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 555/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:53.171175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:53.272567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c3cd-9581-4dda-ad5d-62857f5bef15 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:53.307047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:53.307635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:53.307910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:53.308178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:53.308831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:53.309135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:53.310494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:53.322210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 548/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:53.328050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:53.423003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:53.433568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cff47-f4cb-4c6a-b9db-601b3dae021b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:53.469808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:53.470427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:53.470697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:53.470962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:53.478043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:53.479459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:10:53.490380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:10:53.491360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:10:53.492279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 556/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:10:53.497653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:53.534504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:53.606242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e70d53-370a-4294-8b95-794854debaf2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:53.639145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:53.639753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:53.640357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:53.640657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:53.641343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:53.641640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:53.643058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb779e-493b-49fa-89de-add34c046a04 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:53.656090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 549/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:53.662447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:53.760312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81011541-8d4c-4ec0-a448-f74f7a06e07d None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:53.794453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:53.794965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:53.795236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:53.795499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:53.796207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] RBAC: Adding query filter params (role.id=db1890d2d345456582075dae63d0a3cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=2d6406240f104443b75c8ec7d7999070) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:53.796536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:53.797947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d75356-7c1d-4f3f-bdf0-6d8032e83246 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:53.803753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 557/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:53 2022] GET /identity/v3/role_assignments?user.id=2d6406240f104443b75c8ec7d7999070&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=db1890d2d345456582075dae63d0a3cf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:54.881639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f631f2-5ba4-46cc-a313-0afbcd955dbe None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:54.882450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f631f2-5ba4-46cc-a313-0afbcd955dbe None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:54.882450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f631f2-5ba4-46cc-a313-0afbcd955dbe None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:54.884631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 550/1107] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:54.890513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:54.890960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:54.891053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:54.911351 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:54.912550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:54.921588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:54.979527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 558/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:55.004110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f631f2-5ba4-46cc-a313-0afbcd955dbe None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:55.121229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:55.136755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f631f2-5ba4-46cc-a313-0afbcd955dbe None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.174067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af253b-f85e-4526-ad49-83891c90d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.174696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af253b-f85e-4526-ad49-83891c90d87f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.174963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af253b-f85e-4526-ad49-83891c90d87f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.175209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af253b-f85e-4526-ad49-83891c90d87f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.176519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af253b-f85e-4526-ad49-83891c90d87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.177940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af253b-f85e-4526-ad49-83891c90d87f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.179518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 551/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:55.185570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:55.286159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4da5c-d1fb-4164-8848-5fa4bd0204d3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:55.321014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da6f49-dba2-4c30-9080-8d715c7f019d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:55.321593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da6f49-dba2-4c30-9080-8d715c7f019d None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:55.321860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da6f49-dba2-4c30-9080-8d715c7f019d None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:55.322123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da6f49-dba2-4c30-9080-8d715c7f019d None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:55.322754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da6f49-dba2-4c30-9080-8d715c7f019d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:55.324159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da6f49-dba2-4c30-9080-8d715c7f019d None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:55.343892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:55.351047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 559/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:10:55 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:10:57.361680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1289e2-f2bd-4cdd-b7a7-c13655133d30 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.362282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1289e2-f2bd-4cdd-b7a7-c13655133d30 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.362282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1289e2-f2bd-4cdd-b7a7-c13655133d30 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:57.363607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 552/1111] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:10:57.369961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.370644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.370833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:57.399687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:10:57.400912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:10:57.476293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 560/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:10:57.500369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1289e2-f2bd-4cdd-b7a7-c13655133d30 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:57.635304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1289e2-f2bd-4cdd-b7a7-c13655133d30 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:57.669851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:57.670463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.670734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.670998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] PATH_INFO: `/v3/roles/d4751935dff54d9f83198053a192832d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:57.672520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] RBAC: Authorizing `identity:get_role(role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:57.673885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:57.675211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 553/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:57 2022] GET /identity/v3/roles/d4751935dff54d9f83198053a192832d => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:57.684173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:57.792356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945362a-3481-439f-9533-a7dd0ccc15ad None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:57.831131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:57.838100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:57.838726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:57.838997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:57.839252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] PATH_INFO: `/v3/users/a618c5435e3b4b3b8eecb74ef7ad38a4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:57.853340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] RBAC: Authorizing `identity:get_user(user_id=a618c5435e3b4b3b8eecb74ef7ad38a4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:57.854788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:57.856435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 561/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:10:57 2022] GET /identity/v3/users/a618c5435e3b4b3b8eecb74ef7ad38a4 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:10:57.863142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:57.902147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:57.987469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef29ec-f7bc-4af4-8372-8106a8d6a9f7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:58.023237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:58.023828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:58.024091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:58.024352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:58.091259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:58.092706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:58.120632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:58.203057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 554/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:10:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:10:58.209293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:58.317727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222e124-97ac-4330-b8b8-80ce604515b5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:58.352631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13882c9a-3c27-4ecf-9823-05d1d465a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:58.353250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13882c9a-3c27-4ecf-9823-05d1d465a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:58.353519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13882c9a-3c27-4ecf-9823-05d1d465a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:58.353784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13882c9a-3c27-4ecf-9823-05d1d465a9b1 None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:58.354996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13882c9a-3c27-4ecf-9823-05d1d465a9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=74dd22b318574a0d96e86773e138ec4d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:58.356414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13882c9a-3c27-4ecf-9823-05d1d465a9b1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:58.358067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 562/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:10:58 2022] GET /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:10:58.365230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:10:58.478749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439dd58b-4e64-460c-91ba-88b950192899 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:10:58.505802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:10:58.515663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:10:58.516262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:10:58.516568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:10:58.516830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:10:58.517548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] RBAC: Adding query filter params (role.id=d4751935dff54d9f83198053a192832d, scope.project.id=74dd22b318574a0d96e86773e138ec4d, user.id=a618c5435e3b4b3b8eecb74ef7ad38a4) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:10:58.517847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:10:58.519799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158c3d-98e0-423d-8ae2-ef7581cbc10a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:10:58.525431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 555/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:10:58 2022] GET /identity/v3/role_assignments?user.id=a618c5435e3b4b3b8eecb74ef7ad38a4&scope.project.id=74dd22b318574a0d96e86773e138ec4d&role.id=d4751935dff54d9f83198053a192832d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:00.464571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c05f-bc56-4fcf-a816-6ef9fde8659c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.465427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c05f-bc56-4fcf-a816-6ef9fde8659c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.465427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467c05f-bc56-4fcf-a816-6ef9fde8659c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.467539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 563/1118] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:00.475476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.475947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.476041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.496067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:00.497251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:00.578484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 556/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:11:00.608815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467c05f-bc56-4fcf-a816-6ef9fde8659c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:00.670425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:00.724176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467c05f-bc56-4fcf-a816-6ef9fde8659c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:00.758681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:00.759293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.759564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.759831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] PATH_INFO: `/v3/roles/d4751935dff54d9f83198053a192832d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.761260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] RBAC: Authorizing `identity:get_role(role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:00.762636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:00.763949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 564/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:00 2022] GET /identity/v3/roles/d4751935dff54d9f83198053a192832d => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:00.774051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:00.881251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55efc8-3416-46df-a986-b9b2f35c10dd None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:00.904413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:00.917204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:00.917825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:00.918090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:00.918351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] PATH_INFO: `/v3/users/a618c5435e3b4b3b8eecb74ef7ad38a4` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:00.919487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] RBAC: Authorizing `identity:get_user(user_id=a618c5435e3b4b3b8eecb74ef7ad38a4)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:00.920948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:00.922518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 557/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:00 2022] GET /identity/v3/users/a618c5435e3b4b3b8eecb74ef7ad38a4 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:00.928605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:01.029391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cccd74-e961-449b-b74a-5b9cd9576b4a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:01.052446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:01.069713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08471fa0-2b97-4ac5-bab9-c0d4f9261b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:01.070685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471fa0-2b97-4ac5-bab9-c0d4f9261b73 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:01.071108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471fa0-2b97-4ac5-bab9-c0d4f9261b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:01.071512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08471fa0-2b97-4ac5-bab9-c0d4f9261b73 None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:01.073414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471fa0-2b97-4ac5-bab9-c0d4f9261b73 None admin] RBAC: Authorizing `identity:get_project(project_id=74dd22b318574a0d96e86773e138ec4d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:01.075683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08471fa0-2b97-4ac5-bab9-c0d4f9261b73 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:01.078305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 565/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:00 2022] GET /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:01.085667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:01.191452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02abfc-fbb7-4920-8d92-284a268f21b1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:01.236243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b9fd-0e32-4a57-9f7b-4546645fbf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:01.237246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b9fd-0e32-4a57-9f7b-4546645fbf0a None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:01.237601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b9fd-0e32-4a57-9f7b-4546645fbf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:01.237870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b9fd-0e32-4a57-9f7b-4546645fbf0a None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d/users/a618c5435e3b4b3b8eecb74ef7ad38a4/roles/d4751935dff54d9f83198053a192832d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:01.240206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b9fd-0e32-4a57-9f7b-4546645fbf0a None admin] RBAC: Authorizing `identity:create_grant(project_id=74dd22b318574a0d96e86773e138ec4d, user_id=a618c5435e3b4b3b8eecb74ef7ad38a4, role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:01.241676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111b9fd-0e32-4a57-9f7b-4546645fbf0a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:01.257709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 558/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:11:01 2022] PUT /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d/users/a618c5435e3b4b3b8eecb74ef7ad38a4/roles/d4751935dff54d9f83198053a192832d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:11:03.211425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4366f-f0e0-4a2d-9da4-67ff6969b510 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:03.212312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4366f-f0e0-4a2d-9da4-67ff6969b510 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:03.212312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4366f-f0e0-4a2d-9da4-67ff6969b510 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:03.214335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 566/1124] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:03.219617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:03.220144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:03.220144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:03.240120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:03.241304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:03.287532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:03.310076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 559/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:03.333518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4366f-f0e0-4a2d-9da4-67ff6969b510 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:03.452078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4366f-f0e0-4a2d-9da4-67ff6969b510 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:03.488636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:03.489193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:03.489468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:03.489735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] PATH_INFO: `/v3/roles/d4751935dff54d9f83198053a192832d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:03.491169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] RBAC: Authorizing `identity:get_role(role_id=d4751935dff54d9f83198053a192832d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:03.492560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:03.493903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 567/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:03 2022] GET /identity/v3/roles/d4751935dff54d9f83198053a192832d => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:03.499989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:03.602209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688f83f-a1fd-42a8-9c69-eec61761bf73 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:03.640797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:03.641415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:03.641686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:03.641948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] PATH_INFO: `/v3/users/a618c5435e3b4b3b8eecb74ef7ad38a4` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:03.643116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] RBAC: Authorizing `identity:get_user(user_id=a618c5435e3b4b3b8eecb74ef7ad38a4)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:03.644949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:03.646527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 560/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:03 2022] GET /identity/v3/users/a618c5435e3b4b3b8eecb74ef7ad38a4 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:03.652711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:03.715453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:03.760903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00b402-04f9-4e70-a85f-307dbcdc3c34 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:03.799247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:03.799889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:03.800291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:03.800731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:03.878912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:03.880361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:03.940280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:03.984560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 568/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:03.990896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:04.039910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:04.093184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be698a21-fc5b-425b-833a-d6ab98d22414 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:04.127942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34166b88-ffcf-4557-b763-c26d6e6794eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:04.128614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166b88-ffcf-4557-b763-c26d6e6794eb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:04.128886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166b88-ffcf-4557-b763-c26d6e6794eb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:04.129152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34166b88-ffcf-4557-b763-c26d6e6794eb None admin] PATH_INFO: `/v3/projects/74dd22b318574a0d96e86773e138ec4d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:04.130377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34166b88-ffcf-4557-b763-c26d6e6794eb None admin] RBAC: Authorizing `identity:get_project(project_id=74dd22b318574a0d96e86773e138ec4d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:04.131811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34166b88-ffcf-4557-b763-c26d6e6794eb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:04.133478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 561/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:03 2022] GET /identity/v3/projects/74dd22b318574a0d96e86773e138ec4d => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:04.143812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:04.247829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e27de0-352a-44d5-bf5f-b3b3785b2fcc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:04.283381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:04.283965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:04.284270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:04.284581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:04.285285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] RBAC: Adding query filter params (role.id=d4751935dff54d9f83198053a192832d, scope.project.id=74dd22b318574a0d96e86773e138ec4d, user.id=a618c5435e3b4b3b8eecb74ef7ad38a4) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:04.285592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:04.287004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeb434-400b-43a6-b823-9387f15e76e5 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:04.292898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 569/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:04 2022] GET /identity/v3/role_assignments?user.id=a618c5435e3b4b3b8eecb74ef7ad38a4&scope.project.id=74dd22b318574a0d96e86773e138ec4d&role.id=d4751935dff54d9f83198053a192832d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:06.289127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f1d3b-3d8e-41a9-9950-4e8352f56cbf None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:06.292213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f1d3b-3d8e-41a9-9950-4e8352f56cbf None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:06.292213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f1d3b-3d8e-41a9-9950-4e8352f56cbf None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:06.292213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 562/1131] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:06.297530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415f97-c649-4e62-8d44-852490149755 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:06.298253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415f97-c649-4e62-8d44-852490149755 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:06.298422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53415f97-c649-4e62-8d44-852490149755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:06.319490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-53415f97-c649-4e62-8d44-852490149755 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:06.320722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53415f97-c649-4e62-8d44-852490149755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:06.345064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:06.406239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 570/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:06.430163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f1d3b-3d8e-41a9-9950-4e8352f56cbf None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:06.545767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f1d3b-3d8e-41a9-9950-4e8352f56cbf None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:06.562262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:06.581253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8807d-8d24-44d5-bb27-2283fbdb678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:06.581865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8807d-8d24-44d5-bb27-2283fbdb678d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:06.582134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8807d-8d24-44d5-bb27-2283fbdb678d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:06.582393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8807d-8d24-44d5-bb27-2283fbdb678d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:06.583611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8807d-8d24-44d5-bb27-2283fbdb678d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:06.585061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8807d-8d24-44d5-bb27-2283fbdb678d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:06.586612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 563/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:06.592751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415f97-c649-4e62-8d44-852490149755 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:06.706917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53415f97-c649-4e62-8d44-852490149755 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:06.744035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d53b67-0f45-4878-a0f3-474504f6c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:06.744660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d53b67-0f45-4878-a0f3-474504f6c2b9 None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:06.744935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d53b67-0f45-4878-a0f3-474504f6c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:06.745199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d53b67-0f45-4878-a0f3-474504f6c2b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:06.745838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d53b67-0f45-4878-a0f3-474504f6c2b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:06.747263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d53b67-0f45-4878-a0f3-474504f6c2b9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:06.777467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 571/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:11:06 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:08.774730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74f81-6b63-428e-9ac9-51248f1d3c2a None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:08.775633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74f81-6b63-428e-9ac9-51248f1d3c2a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:08.775633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74f81-6b63-428e-9ac9-51248f1d3c2a None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:08.777818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 564/1135] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:08.784292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:08.785034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:08.785202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:08.804636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:08.810378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:08.812088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:08.883000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 572/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:08.907852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74f81-6b63-428e-9ac9-51248f1d3c2a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:09.014536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74f81-6b63-428e-9ac9-51248f1d3c2a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:09.051248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3448ee9-5841-4cdf-94c8-9dbc99fbde8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:09.051812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3448ee9-5841-4cdf-94c8-9dbc99fbde8a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:09.052082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3448ee9-5841-4cdf-94c8-9dbc99fbde8a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:09.052343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3448ee9-5841-4cdf-94c8-9dbc99fbde8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:09.053706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3448ee9-5841-4cdf-94c8-9dbc99fbde8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:09.055152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3448ee9-5841-4cdf-94c8-9dbc99fbde8a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:09.056759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 565/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:11:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:11:09.065866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:09.169960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057f4d3-d7f9-428a-8c4c-bea36f720471 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:09.204281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b93397-a291-4ddb-bc8b-b10198fc0e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:09.204898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93397-a291-4ddb-bc8b-b10198fc0e7e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:09.205166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93397-a291-4ddb-bc8b-b10198fc0e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:09.205432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b93397-a291-4ddb-bc8b-b10198fc0e7e None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:09.206104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b93397-a291-4ddb-bc8b-b10198fc0e7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:09.207516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b93397-a291-4ddb-bc8b-b10198fc0e7e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:09.216330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:09.234704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 573/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:11:09 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:11.262451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7b58-403d-4551-9c09-74d07e16501e None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.263030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7b58-403d-4551-9c09-74d07e16501e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.263030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de7b58-403d-4551-9c09-74d07e16501e None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.265439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 566/1139] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:11.274668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.275081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.275288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.297991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:11.299188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:11.370531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 574/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:11.395578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7b58-403d-4551-9c09-74d07e16501e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:11.455827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:11.509703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de7b58-403d-4551-9c09-74d07e16501e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.548118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.548773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.549041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.549298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.560765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:11.565393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:11.566533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:11:11.567564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 567/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:11.574556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:11.677327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fe23a-ccec-44d2-b61d-31cc10baac16 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.700338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:11.714538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.715139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.715410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.715675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.716324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:11.716657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:11.718016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:11.726652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 575/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:11:11.732820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:11.842236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71644cd-ace5-4d92-a45f-598fcd648fdd None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:11.857625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:11.883312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:11.883981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:11.884252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:11.884520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] PATH_INFO: `/v3/users/015bb2d905f442f1b8dc774e58c615df` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:11.900060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=015bb2d905f442f1b8dc774e58c615df)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:11.901528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:11.903146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 568/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:11 2022] GET /identity/v3/users/015bb2d905f442f1b8dc774e58c615df => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:11.909911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:12.018350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f12ea-8ef5-4650-abd6-21d01f7c4902 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:12.070583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:12.071188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:12.071466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:12.071721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:12.124693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:12.143075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:12.144576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:12.245074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 576/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:12.254298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:12.357061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986166b-0ec5-47f2-aaa2-ba8ef0fcd0c8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:12.392692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b992-1a0c-4134-a2b0-af397669ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:12.393242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b992-1a0c-4134-a2b0-af397669ee92 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:12.393596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b992-1a0c-4134-a2b0-af397669ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:12.394039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b992-1a0c-4134-a2b0-af397669ee92 None admin] PATH_INFO: `/v3/projects/25db17362fce4936b496acdcdd612cd7` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:12.395193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b992-1a0c-4134-a2b0-af397669ee92 None admin] RBAC: Authorizing `identity:get_project(project_id=25db17362fce4936b496acdcdd612cd7)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:12.396650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b992-1a0c-4134-a2b0-af397669ee92 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:12.398263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 569/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:12 2022] GET /identity/v3/projects/25db17362fce4936b496acdcdd612cd7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:11:12.404497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:12.490927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:12.509087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e5510-ec13-4faf-9d2d-3f35e1df810c None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:12.545682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:12.546532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:12.546876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:12.547218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:12.548291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=25db17362fce4936b496acdcdd612cd7, user.id=015bb2d905f442f1b8dc774e58c615df) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:12.548735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:12.550523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d68e2-f345-4ef6-a31e-8a17767acf61 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:12.556282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 577/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:12 2022] GET /identity/v3/role_assignments?user.id=015bb2d905f442f1b8dc774e58c615df&scope.project.id=25db17362fce4936b496acdcdd612cd7&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:14.532155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3b2b-cd05-4f2c-acca-cfe5a75d6f24 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.532796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3b2b-cd05-4f2c-acca-cfe5a75d6f24 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.532796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df3b2b-cd05-4f2c-acca-cfe5a75d6f24 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.534720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 570/1147] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:14.540649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.541091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.541195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.559981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:14.561203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:14.633160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 578/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:14.656582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df3b2b-cd05-4f2c-acca-cfe5a75d6f24 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:14.711470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:14.772669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df3b2b-cd05-4f2c-acca-cfe5a75d6f24 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:14.811168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:14.811711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.811977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.812236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.822740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:14.827330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:14.828410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:14.829456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:11:14.832570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 571/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:14.834662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:14.913040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:14.935751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0aff7e-bef1-40c2-bcf4-5704bb32dc66 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:14.970531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:14.971122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:14.971444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:14.971703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:14.972353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:14.972677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:14.974028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:14.983263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 579/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:14.992971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:15.100321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:15.104050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c5d00-4745-44c2-9bef-5e9c8f750f18 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:15.141508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:15.142117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:15.142390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:15.142654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] PATH_INFO: `/v3/users/015bb2d905f442f1b8dc774e58c615df` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:15.143880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] RBAC: Authorizing `identity:get_user(user_id=015bb2d905f442f1b8dc774e58c615df)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:15.145342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:15.146892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 572/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:14 2022] GET /identity/v3/users/015bb2d905f442f1b8dc774e58c615df => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:15.152819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:15.255494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc878-760c-4b08-bd6b-a27bcd9e00f9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:15.294041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae262a0-751e-430f-a647-30d629ace52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:15.294655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae262a0-751e-430f-a647-30d629ace52e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:15.294928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae262a0-751e-430f-a647-30d629ace52e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:15.295193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae262a0-751e-430f-a647-30d629ace52e None admin] PATH_INFO: `/v3/projects/25db17362fce4936b496acdcdd612cd7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:15.296438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae262a0-751e-430f-a647-30d629ace52e None admin] RBAC: Authorizing `identity:get_project(project_id=25db17362fce4936b496acdcdd612cd7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:15.297889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae262a0-751e-430f-a647-30d629ace52e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:15.299599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 580/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:15 2022] GET /identity/v3/projects/25db17362fce4936b496acdcdd612cd7 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:15.306014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:15.408434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bbddc-eee7-49ea-a2fa-3736090225c3 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:15.453366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826730a4-d79d-4103-ae6c-d28e84e65678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:15.454298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826730a4-d79d-4103-ae6c-d28e84e65678 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:15.454660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826730a4-d79d-4103-ae6c-d28e84e65678 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:15.454979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826730a4-d79d-4103-ae6c-d28e84e65678 None admin] PATH_INFO: `/v3/projects/25db17362fce4936b496acdcdd612cd7/users/015bb2d905f442f1b8dc774e58c615df/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:15.458112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826730a4-d79d-4103-ae6c-d28e84e65678 None admin] RBAC: Authorizing `identity:create_grant(project_id=25db17362fce4936b496acdcdd612cd7, user_id=015bb2d905f442f1b8dc774e58c615df, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:15.459546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826730a4-d79d-4103-ae6c-d28e84e65678 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:15.476731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 573/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:11:15 2022] PUT /identity/v3/projects/25db17362fce4936b496acdcdd612cd7/users/015bb2d905f442f1b8dc774e58c615df/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:11:17.418754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2eac-a25c-4753-9a9c-bf1d2ef97920 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:17.419337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2eac-a25c-4753-9a9c-bf1d2ef97920 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:17.419337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2eac-a25c-4753-9a9c-bf1d2ef97920 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:17.421436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 581/1154] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:17.429112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:17.429507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:17.429670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:17.458524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:17.459705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:17.480784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:17.532424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 574/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:17.562391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2eac-a25c-4753-9a9c-bf1d2ef97920 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:17.574563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:17.669893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2eac-a25c-4753-9a9c-bf1d2ef97920 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:17.705154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:17.705886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:17.706166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:17.706428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:17.716855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:17.721886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:17.724651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:11:17.725609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 582/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:17.729856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:17.841228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece3aeb-b324-40ab-8236-548038296fbb None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:17.875388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:17.875961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:17.876236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:17.876526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:17.877180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:17.878496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:17.879857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:17.888237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 575/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:17.897939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:17.971873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:18.017602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e82fd4-16ae-464e-ba57-0341d4a020e5 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:18.055794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:18.056426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:18.056706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:18.056957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] PATH_INFO: `/v3/users/015bb2d905f442f1b8dc774e58c615df` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:18.058148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] RBAC: Authorizing `identity:get_user(user_id=015bb2d905f442f1b8dc774e58c615df)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:18.059578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:18.061246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 583/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:17 2022] GET /identity/v3/users/015bb2d905f442f1b8dc774e58c615df => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:18.069232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:18.089272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:18.178661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de3800-ed63-4baf-a149-2e4600b8e9fc None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:18.214539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:18.215132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:18.215403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:18.215660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:18.291470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:18.293775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:18.315008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:18.403891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 576/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:18.413183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:18.524488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e727a1-fa5d-47b3-a1a6-8434628647f8 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:18.569509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d089e38-d838-4e86-965c-ce088720b834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:18.570057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089e38-d838-4e86-965c-ce088720b834 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:18.570322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089e38-d838-4e86-965c-ce088720b834 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:18.570584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d089e38-d838-4e86-965c-ce088720b834 None admin] PATH_INFO: `/v3/projects/25db17362fce4936b496acdcdd612cd7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:18.571806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d089e38-d838-4e86-965c-ce088720b834 None admin] RBAC: Authorizing `identity:get_project(project_id=25db17362fce4936b496acdcdd612cd7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:18.573235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d089e38-d838-4e86-965c-ce088720b834 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:18.574854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 584/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:18 2022] GET /identity/v3/projects/25db17362fce4936b496acdcdd612cd7 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:11:18.582378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:18.687115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45160e-5751-4e9b-b578-7363a1ac29e7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:18.705011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:18.724988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:18.725588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:18.725856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:18.726118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:18.726830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=25db17362fce4936b496acdcdd612cd7, user.id=015bb2d905f442f1b8dc774e58c615df) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:18.727133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:18.728659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d18c3d-52f7-4a32-b8ba-cebea5e3d554 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:18.735099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 577/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:18 2022] GET /identity/v3/role_assignments?user.id=015bb2d905f442f1b8dc774e58c615df&scope.project.id=25db17362fce4936b496acdcdd612cd7&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:20.770773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479dca8-571d-4274-9bca-0278c40413f0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:20.771372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479dca8-571d-4274-9bca-0278c40413f0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:20.771372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479dca8-571d-4274-9bca-0278c40413f0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:20.772693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 585/1162] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:20.778138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:20.778598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:20.778688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:20.798442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:20.799601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:20.875755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 578/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:20.899692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479dca8-571d-4274-9bca-0278c40413f0 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:20.904045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:21.009995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479dca8-571d-4274-9bca-0278c40413f0 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:21.045710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:21.046242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:21.046516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:21.046784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:21.114428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:21.115884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:21.118492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:21.222939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 586/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:21.232817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:21.342372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b7c06-1a45-46ad-88fb-cd17764ba393 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:21.355546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:21.387604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:21.388526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:21.388897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:21.389242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:21.398880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:21.400315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-0eeaa9ef-d910-4cb1-b0bf-3a964215d84b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:21.412164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:21.413432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:11:21.414325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 579/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:11:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:21.421314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:21.525306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3fe66-0dd2-4b77-8d29-5c1a54c03282 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:21.527634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:21.567713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:21.568312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:21.568620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:21.568888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:21.569519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:21.569815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:21.571173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace6bed-342f-422c-aa89-a2329231de6a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:21.578205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 587/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Tue Aug 9 12:11:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:23.554475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331509c-6aad-4e85-97c1-2afd5e238d36 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:23.555054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331509c-6aad-4e85-97c1-2afd5e238d36 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:23.555054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331509c-6aad-4e85-97c1-2afd5e238d36 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:23.556353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 580/1167] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:23.562786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4f53-814f-4a3e-bacc-8df8263b11ea None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:23.563506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4f53-814f-4a3e-bacc-8df8263b11ea None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:23.563662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4f53-814f-4a3e-bacc-8df8263b11ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:23.589243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9bdd4f53-814f-4a3e-bacc-8df8263b11ea None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:23.590420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9bdd4f53-814f-4a3e-bacc-8df8263b11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:23.673084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 588/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:23.709769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331509c-6aad-4e85-97c1-2afd5e238d36 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:23.827566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331509c-6aad-4e85-97c1-2afd5e238d36 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:23.861798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e55b1-7a67-4a22-9d4b-cf1d245b1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:23.862384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e55b1-7a67-4a22-9d4b-cf1d245b1ba0 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:23.862654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e55b1-7a67-4a22-9d4b-cf1d245b1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:23.862913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e55b1-7a67-4a22-9d4b-cf1d245b1ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:23.863654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e55b1-7a67-4a22-9d4b-cf1d245b1ba0 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:23.865074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e55b1-7a67-4a22-9d4b-cf1d245b1ba0 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:23.888094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 581/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Tue Aug 9 12:11:23 2022] POST /identity/v3/domains => generated 267 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:25.927337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dbb86-9cc8-4374-9dd0-c8cf1a1aadff None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:25.927877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dbb86-9cc8-4374-9dd0-c8cf1a1aadff None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:25.927877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dbb86-9cc8-4374-9dd0-c8cf1a1aadff None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:25.929288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 589/1170] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:25.935537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:25.935967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:25.936078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:25.963029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:25.964245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:25.994060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:26.037353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 582/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:26.061148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dbb86-9cc8-4374-9dd0-c8cf1a1aadff None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:26.180461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:26.187725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dbb86-9cc8-4374-9dd0-c8cf1a1aadff None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:26.223461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541ef4b-b750-4589-8084-7bbdec3d7b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:26.224084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541ef4b-b750-4589-8084-7bbdec3d7b32 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:26.224361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541ef4b-b750-4589-8084-7bbdec3d7b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:26.224653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541ef4b-b750-4589-8084-7bbdec3d7b32 None admin] PATH_INFO: `/v3/domains/4045da1fe82142a5bdfb81fcb25643de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:26.235131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541ef4b-b750-4589-8084-7bbdec3d7b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4045da1fe82142a5bdfb81fcb25643de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:26.236604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541ef4b-b750-4589-8084-7bbdec3d7b32 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:26.238220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 590/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Tue Aug 9 12:11:26 2022] GET /identity/v3/domains/4045da1fe82142a5bdfb81fcb25643de => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:26.247253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:26.354862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df9925-12a6-4515-89ac-d467bb4237f4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:26.390881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b37e7-0161-4443-ae0f-2f0a9d3568d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:26.391469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b37e7-0161-4443-ae0f-2f0a9d3568d9 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:26.391744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b37e7-0161-4443-ae0f-2f0a9d3568d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:26.392012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b37e7-0161-4443-ae0f-2f0a9d3568d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:26.392670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b37e7-0161-4443-ae0f-2f0a9d3568d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:26.394110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b37e7-0161-4443-ae0f-2f0a9d3568d9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:26.424951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 583/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:11:26 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:11:28.482791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a453-1629-41ca-994a-3f0e7a85210c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:28.483811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a453-1629-41ca-994a-3f0e7a85210c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:28.483811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26a453-1629-41ca-994a-3f0e7a85210c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:28.485919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 591/1174] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:28.491397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:28.491840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:28.491948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:28.511662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:28.512871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:28.522999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:28.585906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 584/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:28.611380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a453-1629-41ca-994a-3f0e7a85210c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:28.719778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26a453-1629-41ca-994a-3f0e7a85210c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:28.755623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d2b0f-b0fa-40cc-a0d2-562295540f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:28.756240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2b0f-b0fa-40cc-a0d2-562295540f5e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:28.756545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2b0f-b0fa-40cc-a0d2-562295540f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:28.756821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d2b0f-b0fa-40cc-a0d2-562295540f5e None admin] PATH_INFO: `/v3/domains/4045da1fe82142a5bdfb81fcb25643de` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:28.757973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2b0f-b0fa-40cc-a0d2-562295540f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=4045da1fe82142a5bdfb81fcb25643de)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:28.759410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d2b0f-b0fa-40cc-a0d2-562295540f5e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:28.761023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 592/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Tue Aug 9 12:11:28 2022] GET /identity/v3/domains/4045da1fe82142a5bdfb81fcb25643de => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:28.770889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:28.870005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36194b6-036d-468e-9cbf-a9dc3853f330 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:28.908524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc61e05-b562-47ae-bb11-81a7139e5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:28.909116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61e05-b562-47ae-bb11-81a7139e5936 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:28.909390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61e05-b562-47ae-bb11-81a7139e5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:28.909651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc61e05-b562-47ae-bb11-81a7139e5936 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:28.910308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc61e05-b562-47ae-bb11-81a7139e5936 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:28.911739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc61e05-b562-47ae-bb11-81a7139e5936 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:28.931487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:28.936365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 585/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:11:28 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:11:30.975096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2393d-6c14-40fd-867f-a54c902bed55 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:30.975968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2393d-6c14-40fd-867f-a54c902bed55 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:30.975968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2393d-6c14-40fd-867f-a54c902bed55 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:30.978280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 593/1178] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:30.986153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:30.986616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:30.986717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:31.006605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:31.007792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:31.082347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 586/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:11:31.106371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2393d-6c14-40fd-867f-a54c902bed55 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:31.139299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:31.216764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2393d-6c14-40fd-867f-a54c902bed55 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:31.251588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:31.252196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:31.252500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:31.252842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:31.263881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:31.268828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:31.270087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:11:31.271800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 594/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:31.279362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:31.385149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb789e-81ff-4d30-91b9-2e67f5a86538 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:31.415678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:31.422323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:31.422926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:31.423196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:31.423445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:31.424108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:31.424410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:31.425841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:31.434009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 587/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:31.440068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:31.528296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:31.543867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418475e6-cf0f-4488-bdda-6a74e037df1a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:31.578529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:31.579131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:31.579396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:31.579659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] PATH_INFO: `/v3/users/41e1c9d59662442c953ba2fe42e560bd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:31.592909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] RBAC: Authorizing `identity:get_user(user_id=41e1c9d59662442c953ba2fe42e560bd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:31.594340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:31.595904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 595/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:31 2022] GET /identity/v3/users/41e1c9d59662442c953ba2fe42e560bd => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:31.602323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:31.722534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018578-79d7-48d9-ac37-3fca60c3f082 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:31.756806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:31.757407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:31.757689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:31.757949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:31.817595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:31.827566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:31.829053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:31.933583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 588/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:31.943252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:32.054261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04106a1-9d0e-47d3-bbda-16de64b9571e None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:32.089620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656a977-1e2a-454b-9f58-c7389b2ad6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:32.090237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656a977-1e2a-454b-9f58-c7389b2ad6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:32.090514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656a977-1e2a-454b-9f58-c7389b2ad6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:32.090784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656a977-1e2a-454b-9f58-c7389b2ad6a0 None admin] PATH_INFO: `/v3/projects/557e2ac13b9b465f8be24b6813483d9b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:32.092019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656a977-1e2a-454b-9f58-c7389b2ad6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=557e2ac13b9b465f8be24b6813483d9b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:32.093471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656a977-1e2a-454b-9f58-c7389b2ad6a0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:32.095102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 596/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:31 2022] GET /identity/v3/projects/557e2ac13b9b465f8be24b6813483d9b => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:11:32.101535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:32.198667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:32.208964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f0437-0ed0-4d55-b11f-a5e3433d5eed None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:32.245144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:32.245736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:32.246007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:32.246273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:32.246993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=557e2ac13b9b465f8be24b6813483d9b, user.id=41e1c9d59662442c953ba2fe42e560bd) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:32.247296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:32.248753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1bec2-ac4e-48b7-981f-f4f707e383d6 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:32.254398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 589/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:32 2022] GET /identity/v3/role_assignments?user.id=41e1c9d59662442c953ba2fe42e560bd&scope.project.id=557e2ac13b9b465f8be24b6813483d9b&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:34.210198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7a0b-325e-4dea-8292-bf130398888c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:34.210726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7a0b-325e-4dea-8292-bf130398888c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:34.210726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d7a0b-325e-4dea-8292-bf130398888c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:34.212342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 597/1186] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:34.218632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:34.219039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:34.219216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:34.245440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:34.246628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:34.316124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 590/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:34.338395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7a0b-325e-4dea-8292-bf130398888c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:34.355758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:34.448641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d7a0b-325e-4dea-8292-bf130398888c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:34.484174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:34.484848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:34.485123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:34.485385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:34.496980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:34.501556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:34.502658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:11:34.503675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 598/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:34.509148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:34.599128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:34.624213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ba9cd-f57a-480c-a271-744054446a36 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:34.661190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:34.661782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:34.662052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:34.662313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:34.662960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:34.663257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:34.664670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:34.672965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 591/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:34.679667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:34.777045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:34.807970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda0215-83ed-401b-8cba-6a741ea331d0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:34.845123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:34.845730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:34.845997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:34.846258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] PATH_INFO: `/v3/users/41e1c9d59662442c953ba2fe42e560bd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:34.847486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] RBAC: Authorizing `identity:get_user(user_id=41e1c9d59662442c953ba2fe42e560bd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:34.849055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:34.850619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 599/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:34 2022] GET /identity/v3/users/41e1c9d59662442c953ba2fe42e560bd => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:34.856960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:34.967161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9628f-0b04-4408-9ed6-792eb8c7dfc7 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:35.004317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a08f8-8f89-4e3d-bcd9-69840197b74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:35.004964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a08f8-8f89-4e3d-bcd9-69840197b74c None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:35.005239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a08f8-8f89-4e3d-bcd9-69840197b74c None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:35.005510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a08f8-8f89-4e3d-bcd9-69840197b74c None admin] PATH_INFO: `/v3/projects/557e2ac13b9b465f8be24b6813483d9b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:35.006657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a08f8-8f89-4e3d-bcd9-69840197b74c None admin] RBAC: Authorizing `identity:get_project(project_id=557e2ac13b9b465f8be24b6813483d9b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:35.008091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a08f8-8f89-4e3d-bcd9-69840197b74c None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:35.009770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 592/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:34 2022] GET /identity/v3/projects/557e2ac13b9b465f8be24b6813483d9b => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:35.017043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:35.140224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab86ee-3e9b-44f7-8bd2-bf11b4609df1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:35.176717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de6838-482a-47c7-8db7-a9bd0377f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:35.177352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6838-482a-47c7-8db7-a9bd0377f9ff None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:35.177630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6838-482a-47c7-8db7-a9bd0377f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:35.177883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de6838-482a-47c7-8db7-a9bd0377f9ff None admin] PATH_INFO: `/v3/projects/557e2ac13b9b465f8be24b6813483d9b/users/41e1c9d59662442c953ba2fe42e560bd/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:35.179799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de6838-482a-47c7-8db7-a9bd0377f9ff None admin] RBAC: Authorizing `identity:create_grant(project_id=557e2ac13b9b465f8be24b6813483d9b, user_id=41e1c9d59662442c953ba2fe42e560bd, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:35.181254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de6838-482a-47c7-8db7-a9bd0377f9ff None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:35.194082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:35.199518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 600/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:11:35 2022] PUT /identity/v3/projects/557e2ac13b9b465f8be24b6813483d9b/users/41e1c9d59662442c953ba2fe42e560bd/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:11:37.129468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517fa7-807f-4c8d-8299-4092f901d5d2 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:37.130355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517fa7-807f-4c8d-8299-4092f901d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:37.130355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93517fa7-807f-4c8d-8299-4092f901d5d2 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:37.132577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 593/1193] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:11:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:11:37.138916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:37.139924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:37.140119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:37.161647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:11:37.162828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:11:37.235661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 601/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:11:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:11:37.267283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517fa7-807f-4c8d-8299-4092f901d5d2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:37.294056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:37.381460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93517fa7-807f-4c8d-8299-4092f901d5d2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:37.421523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:37.422310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:37.422641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:37.422994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:37.440714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:11:37.445608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:11:37.446675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:11:37.447620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 594/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:11:37.453683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:37.561605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b04db0-b321-45b7-ad6b-0ea2685b347e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:37.603795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:37.611530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:37.612125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:37.612412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:37.612671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:37.613350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:37.613641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:37.615016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:37.623927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 602/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:37.631898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:37.714005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:37.740826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c16be7-84be-4745-b74c-a79ca48223f6 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:37.783435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:37.784068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:37.784337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:37.784610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] PATH_INFO: `/v3/users/41e1c9d59662442c953ba2fe42e560bd` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:37.785853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] RBAC: Authorizing `identity:get_user(user_id=41e1c9d59662442c953ba2fe42e560bd)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:37.787280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:37.788888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 595/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Tue Aug 9 12:11:37 2022] GET /identity/v3/users/41e1c9d59662442c953ba2fe42e560bd => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:37.796884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:37.914048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359235d-aeb3-45ee-9bc6-76bcc76378e9 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:37.949354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:37.949927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:37.950198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:37.950467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:38.014073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:38.025720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:38.028048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:38.145560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 603/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:11:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:11:38.151978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:38.281184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c917fd-f191-401b-a2f3-daea06e73632 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:38.322483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b0f0-06b9-4574-b38c-bebba92f99bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:38.323106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b0f0-06b9-4574-b38c-bebba92f99bb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:38.323377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b0f0-06b9-4574-b38c-bebba92f99bb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:38.323643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b0f0-06b9-4574-b38c-bebba92f99bb None admin] PATH_INFO: `/v3/projects/557e2ac13b9b465f8be24b6813483d9b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:38.324820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b0f0-06b9-4574-b38c-bebba92f99bb None admin] RBAC: Authorizing `identity:get_project(project_id=557e2ac13b9b465f8be24b6813483d9b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:38.326250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b0f0-06b9-4574-b38c-bebba92f99bb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:38.327911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 596/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Tue Aug 9 12:11:38 2022] GET /identity/v3/projects/557e2ac13b9b465f8be24b6813483d9b => generated 361 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:38.335157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:11:38.452329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:38.462086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001e62f-effe-49cc-8fc0-b806fa87bbf2 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:11:38.497444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:11:38.498018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:11:38.498314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:11:38.498571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:11:38.499265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=557e2ac13b9b465f8be24b6813483d9b, user.id=41e1c9d59662442c953ba2fe42e560bd) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:11:38.499610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:11:38.501062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c316-31d5-41c9-9a5b-4eb4ef969e9b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:11:38.507427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 604/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:11:38 2022] GET /identity/v3/role_assignments?user.id=41e1c9d59662442c953ba2fe42e560bd&scope.project.id=557e2ac13b9b465f8be24b6813483d9b&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:11:48.317390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=94 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:11:48.504532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=22 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:33.509181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7eb35-8c6a-410e-8395-be880df3f9eb None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:33.509847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7eb35-8c6a-410e-8395-be880df3f9eb None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:33.509847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7eb35-8c6a-410e-8395-be880df3f9eb None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:33.511129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 597/1201] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:33.516865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:33.517300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:33.517387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:33.540767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:33.542109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:33.624831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 605/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:33.648795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7eb35-8c6a-410e-8395-be880df3f9eb None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:33.789297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7eb35-8c6a-410e-8395-be880df3f9eb None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:33.832360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:33.833026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:33.833296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:33.833558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:33.849174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:33.851567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:33.872303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:33.873786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:33.877751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:33.877751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:33.877751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:33.877751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 598/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:33.881258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:34.020241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fd783-5ff0-4340-b7ef-6377a6d31aa6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:34.057171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:34.064209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:34.064984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.065483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.065659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.066388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:34.066709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:34.068071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01b882-3eb9-4a1b-a7ca-f09dd2c924c8 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:34.085378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 606/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:34.087328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:34.162716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:34.237148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc662047-013e-40c6-9f2d-291b239f605f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:34.278055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436007b-06ae-48e9-ab1b-2686c342ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:34.278707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436007b-06ae-48e9-ab1b-2686c342ebf7 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:34.278988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436007b-06ae-48e9-ab1b-2686c342ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:34.279260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436007b-06ae-48e9-ab1b-2686c342ebf7 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:34.279919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436007b-06ae-48e9-ab1b-2686c342ebf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:34.281419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8436007b-06ae-48e9-ab1b-2686c342ebf7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:34.306869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 599/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Tue Aug 9 12:12:34 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:12:36.417741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8718ae-2e7c-48ff-ad97-104794d56bfa None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.418301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8718ae-2e7c-48ff-ad97-104794d56bfa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.418301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8718ae-2e7c-48ff-ad97-104794d56bfa None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.419888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 607/1206] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:36.426353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.426863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.426963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.447422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:36.448659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:36.528069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 600/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:36.551678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8718ae-2e7c-48ff-ad97-104794d56bfa None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.674691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8718ae-2e7c-48ff-ad97-104794d56bfa None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:36.721043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:36.721769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.722044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.722439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.734451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:36.739244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:36.740290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:36.741181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 608/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:36.746753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.803692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:36.883395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fdf85-6828-44cd-ab3b-325138d20b66 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:36.921035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:36.921645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:36.921961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:36.922227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:36.922928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:36.923250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:36.924902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:36.934699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 601/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:36.940448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:36.999974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:37.054851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0d390-343d-4d6d-96c4-4a719a2a68dc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:37.098353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:37.099425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:37.100004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:37.100292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:37.115472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:37.117033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:37.132505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:37.133926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:37.135197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:37.135197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:37.135197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:37.138590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 609/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:37.139875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:37.253018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:37.257453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9aebfc-a4b5-4273-90ae-4e8c243f9ae8 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:37.305223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:37.305867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:37.306129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:37.306402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:37.307074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:37.307363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:37.308816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:37.326069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 602/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:37.333138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:37.450253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d4ff-e16b-41c4-be85-5a318aa6b215 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:37.451932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:37.494834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:37.495564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:37.495938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:37.496257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:37.505452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:37.507220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:37.522837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:37.524199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:37.525649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:37.529229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 610/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:37.530442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:37.665358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23f174-87ae-4212-a6ac-2a76b1261f7e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:37.705620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:37.706247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:37.706534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:37.706796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:37.707516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:37.707814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:37.709296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:37.729081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 603/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:37.734971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:37.849314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cff33a-e587-44a6-9097-72bffc05b1db None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:37.893864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:37.894581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:37.894858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:37.895148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:37.928530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:37.980814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:37.982192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.103872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 611/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:12:38.110598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:38.131421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:38.241456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3276c6e7-d6b1-45ba-85cb-2b17ad41d950 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:38.282225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:38.282867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.283337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.283621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.295920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:38.297483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:38.315499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:38.316607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:38.317528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:38.317528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:38.317528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:38.317528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 604/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:12:38.323098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:38.405089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:38.452146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf149cbc-8dd4-4b8a-9ab0-4c2fc5a61358 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:38.501152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:38.501930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.502305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.502586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.503477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:38.503799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:38.505541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.525322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 612/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:38.532758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:38.633672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:38.683145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be0cdb-5614-4315-ae68-ab68e3e15d4f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:38.730754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:38.731579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.731856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.732118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.743256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:38.744744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:38.758105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:38.760152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:38.761715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 605/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:38.766885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:38.915423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8b5e-4a03-45d9-8172-942a0faa9f02 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:38.944260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:38.958077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:38.958812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:38.959179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:38.959535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:38.960316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:38.961934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:38.965469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd90c0a-d80a-4387-9037-8bb4a950c3c7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:38.984956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 613/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:38.987660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:39.110292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091427-d98e-489b-aaa7-aebfd942034d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:39.140235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:39.146737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:39.147572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:39.147910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:39.148220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:39.149096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=be8c3d3074604b1181652ac0c346c906) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:39.149471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:39.151024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327460c-7f95-4cc0-acbd-af3066108e32 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:39.165682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 606/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:38 2022] GET /identity/v3/role_assignments?user.id=be8c3d3074604b1181652ac0c346c906&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:41.273092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6cf6-f2dd-4863-bb43-b143b3c08807 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.273659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6cf6-f2dd-4863-bb43-b143b3c08807 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.273659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e6cf6-f2dd-4863-bb43-b143b3c08807 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.275154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 614/1220] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:41.281181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.281639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.281743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.303108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:41.304348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:41.381574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 607/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:41.404763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e6cf6-f2dd-4863-bb43-b143b3c08807 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:41.507021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e6cf6-f2dd-4863-bb43-b143b3c08807 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:41.545251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:41.545777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.546030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.546292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.557375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:41.561998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:41.563195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:41.564303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 615/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:12:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:41.570071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:41.685220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4102c8d-0c04-43d5-a541-be6f77f38e20 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:41.713167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:41.724433 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:41.725038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.725311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.725571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.726225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] RBAC: Adding query filter params (name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:41.726519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:41.727905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:41.736009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 608/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:12:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:41.742329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:41.791368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:41.851514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e410a-fd7c-4fe0-a033-6b3a3b47f5ce None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:41.890574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:41.891240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:41.891511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:41.891800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:41.903249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:41.904732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:41.919219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:41.920439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:41.921550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:41.921550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:41.921550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:41.921550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 616/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:41.926640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:42.036289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646ba73-593d-4c4e-a830-07383cca5fff None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:42.073619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:42.074301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:42.074622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:42.074918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:42.075640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:42.075983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:42.077509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:42.091056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 609/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:42.097683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:42.200776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:42.208029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4365d18-fb8c-4905-b514-71343f2d7386 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:42.248373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:42.249026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:42.249297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:42.249563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:42.257970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:42.259403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:42.271847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:42.272857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:42.274262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 617/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:42.279111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:42.331932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:42.397183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c053dd-1a59-42f8-b7af-1e444bbbac72 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:42.432277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:42.432923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:42.433191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:42.433452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:42.434175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:42.434469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:42.435876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:42.455115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 610/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:42.462538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:42.572878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2dc86-c022-44dd-889b-3af780116895 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:42.616576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:42.617203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:42.617480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:42.617735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:42.629915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:42.631678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:42.653639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:42.655617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:42.657377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:42.657377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:42.657377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:42.659031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 618/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:42.665308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:42.767783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193131d5-516f-440d-be3f-c70ff2b3835a None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:42.770098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:42.806493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:42.807100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:42.807381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:42.807639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:42.808279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:42.808604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:42.809961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:42.822317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 611/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:42.828191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:42.837754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:42.937172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf598357-3bdf-41fe-9245-727c463aff8b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:42.983729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:42.984530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:42.984827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:42.985100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:42.992658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:42.994113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:43.007025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:43.007956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:43.008916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 619/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:12:43.015136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:43.125333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a35e18-6401-49a5-a8b6-cfbd53b13634 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:43.159811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:43.160441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.160715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.160976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.161764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:43.162101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:43.163668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e364e-3763-4f36-ba8c-bacb31ab9f44 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:43.176978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 612/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:43.183654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:43.255389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:43.293029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc71f24-ecb8-4951-b54c-8b87cfc1f67b None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:43.328223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b01a-b66e-47ce-b5a9-e619b5e402b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:43.328992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b01a-b66e-47ce-b5a9-e619b5e402b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:43.329270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b01a-b66e-47ce-b5a9-e619b5e402b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:43.329543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b01a-b66e-47ce-b5a9-e619b5e402b3 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/be8c3d3074604b1181652ac0c346c906/roles/7c010f452b494940a2e52075365df1cf` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:43.344138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b01a-b66e-47ce-b5a9-e619b5e402b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=be8c3d3074604b1181652ac0c346c906, role_id=7c010f452b494940a2e52075365df1cf)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:43.345860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b01a-b66e-47ce-b5a9-e619b5e402b3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:43.358528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 620/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:12:43 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/be8c3d3074604b1181652ac0c346c906/roles/7c010f452b494940a2e52075365df1cf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:12:45.436752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2b89-c7e7-4d84-8423-7405add8c1c5 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:45.437342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2b89-c7e7-4d84-8423-7405add8c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:45.437342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2b89-c7e7-4d84-8423-7405add8c1c5 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:45.438863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 613/1233] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:45.444807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:45.445254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:45.445376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:45.463916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:45.465157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:45.537078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 621/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:45.562154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2b89-c7e7-4d84-8423-7405add8c1c5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:45.591040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:45.686409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2b89-c7e7-4d84-8423-7405add8c1c5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:45.722921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:45.723531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:45.723770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:45.724014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:45.735064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:45.739946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:45.741022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:45.741876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 614/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Tue Aug 9 12:12:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 12:12:45.747408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:45.795009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:45.853846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d498-e41f-43bb-8f25-fb63676a23fb None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:45.889999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:45.890635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:45.890936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:45.891185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:45.891899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:45.892255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:45.893797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:45.903417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 622/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Tue Aug 9 12:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:45.909607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.007186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:46.026024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a328d9-ab4f-4fb8-b86b-0cd8fbd931ce None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.061685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.062382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.062654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.062948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.074383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.075889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:46.091885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:46.093047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:46.094052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:46.094052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:46.094052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:46.094052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 615/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:46.099240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.207080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87183c4d-220c-47f3-a5f7-53c539aeb2f0 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.216131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:46.242421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.243029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.243305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.243572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.244206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:46.244540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.247044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.259110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 623/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:46.265142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.368125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86fb5-b4da-43bd-af68-6e5e40f5c551 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.402911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.403554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.403826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.404093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.406816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:46.412536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.414384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:46.426114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:46.427207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:46.428178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 616/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:46.433328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.543504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3c894-8fd0-4a1e-8722-9ab3e787a5ca None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.581290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.581894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.582167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.582431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.583159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:46.583454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.584901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.603342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 624/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:46.609694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.722538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6112c3ac-f71b-43f2-93ed-dba38beff237 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:46.758806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:46.759419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:46.759696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:46.759965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:46.833954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:46.841423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:46.842903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:46.951190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 617/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:12:46.957539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:46.987630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:47.067097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932a3d3-68d0-4fcc-9db2-981e030474c7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:47.105948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:47.106568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:47.106989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:47.107263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:47.118751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:47.120271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:47.136254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:47.137385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:47.138307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:47.138307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:47.138307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:47.138307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 625/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:47.144407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:47.237590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:47.244211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e871513-c02b-4854-be83-3c023bff87d2 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:47.279214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:47.279848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:47.280089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:47.280411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:47.281016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:47.281312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:47.283031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:47.294310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 618/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:47.300869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:47.384861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:47.408369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f049125-b546-478a-9d1b-e636929ca2a3 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:47.443726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:47.444442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:47.444732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:47.444986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:47.454175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:47.456019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:47.468611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:47.470751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:47.471826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 626/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:47.476243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:47.585873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59471906-072f-4644-a4bf-fa4d5f3057fd None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:47.624305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:47.625258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:47.625748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:47.626099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:47.627234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:47.627774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:47.629882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068bdd-b948-4208-853c-c73c729a4238 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:47.645483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 619/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:47.653296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:47.772922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21c92f-58f0-4918-ae68-b90cef2a174f None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:47.808465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:47.809076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:47.809348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:47.809615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:47.810339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] RBAC: Adding query filter params (role.id=7c010f452b494940a2e52075365df1cf, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=be8c3d3074604b1181652ac0c346c906) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:47.810667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:47.812087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38864aa-c68b-4dbf-bf8a-974df1102b0c None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:47.818975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 627/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:47 2022] GET /identity/v3/role_assignments?user.id=be8c3d3074604b1181652ac0c346c906&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=7c010f452b494940a2e52075365df1cf => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:49.855389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4bb9d-495c-4245-8c3d-f184a1ac3b47 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:49.855980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4bb9d-495c-4245-8c3d-f184a1ac3b47 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:49.855980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4bb9d-495c-4245-8c3d-f184a1ac3b47 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:49.857347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 620/1247] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:49.863258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:49.863761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:49.863862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:49.870721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:49.884073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:49.885275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:49.966583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:12:49.995456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4bb9d-495c-4245-8c3d-f184a1ac3b47 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:50.019324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:50.113951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4bb9d-495c-4245-8c3d-f184a1ac3b47 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:50.155614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:50.156257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:50.156638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:50.156869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:50.167929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:50.172661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:50.173745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:50.174601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 621/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:50.180488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:50.287541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8ea39-ab8f-4a5a-afaa-86acf6191d57 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:50.320117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:50.331656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:50.332261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:50.332571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:50.332836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:50.333488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:50.333790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:50.335153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:50.343785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 629/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:50.349887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:50.436289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:50.460445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16296805-1063-43e8-aed0-3ab82ab029c1 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:50.496131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:50.496826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:50.497103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:50.497372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:50.508785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:50.510276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:50.526860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:50.528039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:50.529128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:50.529128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:50.529128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:50.529128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 622/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:50.534075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:50.640754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298102-7fd9-46c9-a8d9-bccf41e5243a None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:50.679153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:50.679763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:50.680041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:50.680304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:50.680977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:50.681274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:50.682645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:50.695036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 630/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:50.700850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:50.809041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13109612-4834-4466-ab05-fbe5e4aca76d None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:50.835902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:50.844678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:50.845479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:50.845771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:50.845996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:50.853852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:50.855302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:50.866324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:50.872655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:50.873813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 623/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:50.874537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:50.934329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:50.984204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0f1e2-356b-44af-ae03-1b252290bd05 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:51.025578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:51.026186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:51.026460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:51.026728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:51.027454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:51.027748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:51.029203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:51.047519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 631/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:51.054058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:51.163347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ae970-b9ff-481d-a4b7-4f614c2d0c15 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:51.200647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:51.201398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:51.201821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:51.202096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:51.263036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:51.277286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:51.278910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:51.379853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 624/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:12:51.385859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:51.499829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190e699-6f97-4a8a-a2a3-ad7beaabcddd None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:51.517376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:51.542396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:51.543085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:51.543387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:51.543676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:51.555322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:51.557012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:51.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:51.574792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:51.575705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:51.575705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:51.575705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:51.575705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 632/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:51.580701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:51.687957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:51.702914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c12662-6d62-455c-9995-cb83c043897f None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:51.744684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:51.745298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:51.745600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:51.746027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:51.746787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:51.747143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:51.748699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:51.761852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 625/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:51.768573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:51.893745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f4434-140f-4a42-901a-c5f9002ff1cf None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:51.932530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:51.933132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:51.933408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:51.933677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:51.941018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:51.942636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:51.958228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:51.959363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:51.960650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 633/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:51.965414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:52.077606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cca6c-72bc-4c92-8e20-bcfaa90c7310 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:52.116231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:52.117055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:52.117326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:52.117587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:52.118277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:52.118601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:52.120029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaa340-2386-47fe-b029-99bd92dad84d None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:52.136073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 626/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:52.143212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:52.170309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:52.254266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20eed25-9a78-4b5f-a6cd-cdf2310a26dc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:52.290953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:52.291687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:52.291964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:52.292345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:52.293243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=be8c3d3074604b1181652ac0c346c906) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:52.293605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:52.295352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c9346-050c-4d2f-82ee-df493c2d0efe None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:52.302863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 634/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:12:52 2022] GET /identity/v3/role_assignments?user.id=be8c3d3074604b1181652ac0c346c906&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=1e154845d18647eaa8a61129c3419d62 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:54.387797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd784f-1b6e-48ce-a972-c18435e94cc9 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:54.388436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd784f-1b6e-48ce-a972-c18435e94cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:54.388436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd784f-1b6e-48ce-a972-c18435e94cc9 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:54.390052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 627/1261] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:12:54.395968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:54.396460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:54.396593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:54.416821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:54.418169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:54.499077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 635/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 12:12:54.522337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd784f-1b6e-48ce-a972-c18435e94cc9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:54.535179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:54.638026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd784f-1b6e-48ce-a972-c18435e94cc9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:54.681692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:54.682365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:54.682850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:54.682991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:54.695985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:54.700703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:54.701699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:54.702555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 628/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:54.708626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:54.728560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:54.815674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424deaf-bba2-4709-b967-6e412c982b6a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:54.851502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:54.852138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:54.852420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:54.852712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:54.853373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:54.853666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:54.855016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:54.863340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 636/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:54.869336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:54.944481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:54.975394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f0d15-5ee7-4022-a097-dc0b2ed5d2fa None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:55.009790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:55.010434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:55.010708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:55.010970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:55.022659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:55.024114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:55.039379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:55.040580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:55.041828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:55.041828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:55.041828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:55.041828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 629/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:55.046487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:55.125846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:55.146663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a5430-7f38-4443-b76e-3ca06d354b07 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:55.180807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:55.181398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:55.181671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:55.181928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:55.182557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:55.182849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:55.184231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:55.196236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 637/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:55.202395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:55.304141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbbed1-d8b9-4e85-a2da-f8c7ca542398 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:55.323901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:55.341536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:55.342139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:55.342408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:55.342665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:55.350418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:55.351851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:55.362862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:55.363943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:55.364931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 630/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:55.369937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:55.482993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675337ca-9ed4-4631-8fb2-be7069deae10 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:55.519206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:55.519800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:55.520085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:55.520354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:55.521108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:55.521412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:55.522842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:55.531657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:55.541226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 638/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:55.547188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:55.659043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ecd5d-6624-4f5a-8ef0-b2d086f39fa9 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:55.694812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:55.695465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:55.695741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:55.696009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:55.706777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:55.708230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:55.722515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:55.723564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:55.726009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:55.726009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:55.726009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:55.726009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 631/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:55.732456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:55.840259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b937ab-e7b6-48b6-838d-3b45912c73a7 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:55.875828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:55.876468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:55.876733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:55.876996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:55.877624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:55.877921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:55.879273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:55.892879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 639/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:55.901263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:55.934807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:56.007056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018acb2-898d-49e5-b534-cdffb8908656 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:56.046609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:56.047225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:56.047499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:56.047763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:56.055190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:56.056662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:12:56.068359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:56.069384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:12:56.070512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 632/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:56.075639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:56.138160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:56.187691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f037d-bdd4-4678-92da-149284cffc19 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:56.222487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:56.223080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:56.223354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:56.223625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:56.224312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:56.224647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:56.226067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2a057-068f-44a8-b234-f5ae71888f54 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:56.239550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 640/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:12:56.249010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:56.345592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:56.356314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3395e-e174-4d61-ac15-d1f24b2c166e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:56.394067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f73d8b-a19a-42e3-8e12-b5a1a75806f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:56.394636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f73d8b-a19a-42e3-8e12-b5a1a75806f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:56.394909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f73d8b-a19a-42e3-8e12-b5a1a75806f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:56.395167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f73d8b-a19a-42e3-8e12-b5a1a75806f7 None admin] PATH_INFO: `/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/be8c3d3074604b1181652ac0c346c906/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:56.397230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f73d8b-a19a-42e3-8e12-b5a1a75806f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user_id=be8c3d3074604b1181652ac0c346c906, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:56.398679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f73d8b-a19a-42e3-8e12-b5a1a75806f7 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:56.415033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 633/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Tue Aug 9 12:12:56 2022] PUT /identity/v3/projects/1b62ad6eeb5e4d14b62d5ec4e233aafd/users/be8c3d3074604b1181652ac0c346c906/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:12:58.420049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a37d-cac0-495f-8adb-4a75efb5c053 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:58.420683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a37d-cac0-495f-8adb-4a75efb5c053 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:58.420683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250a37d-cac0-495f-8adb-4a75efb5c053 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:58.421963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 641/1274] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:12:58.428935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:58.429655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:58.429853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:58.455188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:12:58.457048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:12:58.534739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 634/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:12:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:12:58.558032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a37d-cac0-495f-8adb-4a75efb5c053 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:58.674859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250a37d-cac0-495f-8adb-4a75efb5c053 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:58.700215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:58.720528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:58.721328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:58.721626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:58.721983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:58.732812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 12:12:58.737451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:58.738588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:58.739652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 642/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Tue Aug 9 12:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:58.744772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:58.826148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:58.846323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4f3c-1dae-43a2-90b3-b354c3d05e7e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:58.882262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:58.882866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:58.883142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:58.883410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:58.884079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:58.884404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:58.885815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:58.898632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 635/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Tue Aug 9 12:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:58.907409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:59.019619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b837f8-3adc-4d9b-b543-038942928921 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:59.067141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:59.067762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:59.068035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:59.068309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:59.079638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:59.081114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:12:59.096853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:59.097898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:12:59.098982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:12:59.098982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:12:59.098982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:59.098982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 643/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:59.104007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:59.209282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec6da4-a80e-4860-951d-b9d8b6a16045 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:59.253100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:59.253695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:59.253963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:59.254221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:59.254852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:59.255148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:59.256540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:59.268946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 636/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:59.274911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:59.311462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:59.388210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a11a5-525e-40ab-a99e-7aa87d51a032 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:59.427180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:59.427771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:59.428048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:59.428308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:59.435803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:59.437261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 12:12:59.450230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:12:59.451315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:12:59.452330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 644/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:12:59.457986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:59.463918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:59.571670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a0e24-9043-4f38-ba92-2e5c2e074298 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:59.606909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:59.607500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:59.607768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:59.608031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:59.608784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:12:59.609079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:59.610546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:59.628877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 637/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Tue Aug 9 12:12:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:12:59.635989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:12:59.743883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:59.755107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9c217-26da-42bb-8bec-18a68e88bb07 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:12:59.790241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:12:59.790840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:12:59.791108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:12:59.791378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:12:59.874588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:12:59.876021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:12:59.976565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:12:59.990615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 645/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Tue Aug 9 12:12:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 12:13:00.000118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:00.069091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:00.119061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56572e1-7de3-4f3d-b8c5-5bb16e748ece None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:00.154388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:00.154934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:00.155210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:00.155459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:00.165698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:00.167145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 12:13:00.181287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:13:00.182369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 12:13:00.183400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 12:13:00.183400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 12:13:00.183400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:13:00.184548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 638/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:13:00.188249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:00.289323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d1f90-e244-4e7e-b5b9-d65ee4f6e3b1 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:00.324611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:00.325218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:00.325492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:00.325754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:00.326391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:00.326690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:00.328051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:00.339724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 646/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Tue Aug 9 12:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:00.346644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:00.459277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef84c0-ae8b-48b6-8ec5-e9410a59403e None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:00.473203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:00.500174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:00.500813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:00.501127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:00.501396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:00.508300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:00.509793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 12:13:00.521300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:13:00.522399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:13:00.523499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 639/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Tue Aug 9 12:13:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:13:00.528416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:00.583373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:00.650954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12730cc-2050-4409-b09d-05588aeb67f6 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:00.686165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:00.686766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:00.687038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:00.687308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:00.687995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:00.688303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:00.689919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328daf44-7e9b-4d6d-bdad-b09e823bc7c6 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:00.702346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 647/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Tue Aug 9 12:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:00.708817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:00.831190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f06f3e-cfa1-4a26-8902-a96727051f61 None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:00.870978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:00.871897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:00.872326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:00.872840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:00.873955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] RBAC: Adding query filter params (role.id=1e154845d18647eaa8a61129c3419d62, scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd, user.id=be8c3d3074604b1181652ac0c346c906) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:00.874434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:00.876719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb19c4-4f63-42da-a759-ba798bbf66ec None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:00.882815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 640/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Tue Aug 9 12:13:00 2022] GET /identity/v3/role_assignments?user.id=be8c3d3074604b1181652ac0c346c906&scope.project.id=1b62ad6eeb5e4d14b62d5ec4e233aafd&role.id=1e154845d18647eaa8a61129c3419d62 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:02.890751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5448-8f99-45bb-bd9a-81f42834f9a6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:02.891185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5448-8f99-45bb-bd9a-81f42834f9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:02.891299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5448-8f99-45bb-bd9a-81f42834f9a6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:02.892719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 648/1288] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:02.899000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:02.899777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:02.899940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:02.922215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:02.923467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:02.953540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:02.991708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 641/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:13:03.014352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5448-8f99-45bb-bd9a-81f42834f9a6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:03.121881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5448-8f99-45bb-bd9a-81f42834f9a6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:03.132339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:03.162847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:03.163428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:03.163705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:03.163972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:03.164567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:03.165964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:13:03.174978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:13:03.176153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:03.177328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 649/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:13:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:13:03.184301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:03.303467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aef68e-dfc2-4426-a5cc-3d0a48988465 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:03.337651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:03.338238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:03.338491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:03.338746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:03.339354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:03.339647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:03.341025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710b582-bc7a-41b9-aa10-a53605d19485 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:03.345991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 642/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 9 12:13:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:03.354669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:03.458852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ff5d5-8c44-4ee6-80ab-033c51da43fc None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:03.493856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:03.494452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:03.494725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:03.494996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] PATH_INFO: `/v3/services` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:03.495618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:03.495920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:03.497321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42daee-d9ea-439d-9146-e3d7cffcf69a None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:03.502094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 650/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 9 12:13:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:05.483162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea75c-1515-47fe-ac9d-9de3bedb628d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:05.484056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea75c-1515-47fe-ac9d-9de3bedb628d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:05.484056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacea75c-1515-47fe-ac9d-9de3bedb628d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:05.486234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 643/1293] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:05.492331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250761-05e2-4641-9b16-54a6c2c1153f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:05.492813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250761-05e2-4641-9b16-54a6c2c1153f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:05.492907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250761-05e2-4641-9b16-54a6c2c1153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:05.520697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-78250761-05e2-4641-9b16-54a6c2c1153f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:05.521889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-78250761-05e2-4641-9b16-54a6c2c1153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:05.555398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:05.595436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 651/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:13:05.618232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacea75c-1515-47fe-ac9d-9de3bedb628d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:05.653961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:05.730525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacea75c-1515-47fe-ac9d-9de3bedb628d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:05.767866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa82476-e833-4acf-a9d5-c48da87a7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:05.768487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa82476-e833-4acf-a9d5-c48da87a7619 None admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:05.768770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa82476-e833-4acf-a9d5-c48da87a7619 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:05.769029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa82476-e833-4acf-a9d5-c48da87a7619 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:05.769665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa82476-e833-4acf-a9d5-c48da87a7619 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:05.771025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa82476-e833-4acf-a9d5-c48da87a7619 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:05.792305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 644/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Tue Aug 9 12:13:05 2022] POST /identity/v3/services => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:13:07.834251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc6cf-2745-4e6d-b470-4e3cb95c4f1b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:07.834858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc6cf-2745-4e6d-b470-4e3cb95c4f1b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:07.834858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc6cf-2745-4e6d-b470-4e3cb95c4f1b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:07.836150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 652/1296] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:07.842411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:07.843125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:07.843330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:07.868971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:07.870152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:07.961585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 645/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:13:07.984269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc6cf-2745-4e6d-b470-4e3cb95c4f1b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:08.108943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc6cf-2745-4e6d-b470-4e3cb95c4f1b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:08.145162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:08.145821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:08.146094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:08.146356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:08.146936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:08.148294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:13:08.157668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:13:08.158794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:08.160070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 653/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:13:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:13:08.165057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:08.183748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:08.287337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac8080-3b95-481d-952e-cd9987fb9dec None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:08.323136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:08.323732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:08.324014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:08.324268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:08.324927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] RBAC: Adding query filter params (name=placement) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:08.325224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:08.326591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:08.332567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 646/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 9 12:13:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:08.338987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:08.376105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:08.449857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b0764-f817-4225-8d32-6397a43248ad None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:08.488946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:08.489777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:08.490176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:08.490576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:08.491647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] RBAC: Adding query filter params (interface=public, service_id=4acabb26f02a40569dd5789c22c01dfb, region_id=RegionOne) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:08.492085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:08.493884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4ed31-b097-4d4c-8338-eb536212a5cd None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:08.499436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 654/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Tue Aug 9 12:13:08 2022] GET /identity/v3/endpoints?service_id=4acabb26f02a40569dd5789c22c01dfb&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:08.505680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:08.596307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:08.618632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d236-6a26-48c7-b979-ba941f2757ca None admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:08.661458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a7a8e-92aa-4fa1-83da-8f32468b32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:08.662211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a7a8e-92aa-4fa1-83da-8f32468b32e9 None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:08.662484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a7a8e-92aa-4fa1-83da-8f32468b32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:08.663046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a7a8e-92aa-4fa1-83da-8f32468b32e9 None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:08.663731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a7a8e-92aa-4fa1-83da-8f32468b32e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:08.665483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a7a8e-92aa-4fa1-83da-8f32468b32e9 None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:08.674191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 647/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Tue Aug 9 12:13:08 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:13:10.675721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714a97c-1821-4b88-8237-dc6331896af6 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:10.676284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714a97c-1821-4b88-8237-dc6331896af6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:10.676284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714a97c-1821-4b88-8237-dc6331896af6 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:10.677739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 655/1302] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:13:10.683199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:10.683615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:10.683728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:10.703738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:13:10.705087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:13:10.783254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 648/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:13:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 12:13:10.806198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714a97c-1821-4b88-8237-dc6331896af6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:10.917416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:10.925099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714a97c-1821-4b88-8237-dc6331896af6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:10.958587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:10.959137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:10.959410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:10.959680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:10.960241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:10.961642 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:13:10.970144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:13:10.971260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application with Lock( Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: ERROR keystone.server.flask.application Aug 09 12:13:10.972196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 656/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Tue Aug 9 12:13:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 12:13:10.980150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:11.069867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:11.104645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23b4ff-f048-4ffa-bfbb-fa9fe99097d9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:11.139891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:11.140512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:11.140786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:11.141052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] PATH_INFO: `/v3/services` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:11.141648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:13:11.141943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:11.143313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c201e-a388-4e2e-8daa-41c3fd55cecb None admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:11.148521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 649/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Tue Aug 9 12:13:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:13:11.154497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:13:11.255695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac1d30-9585-40ae-be78-d7c071f91276 None admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:13:11.293429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052dc231-3884-4e4d-b032-4c277464398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:13:11.294307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc231-3884-4e4d-b032-4c277464398e None admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:13:11.294725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc231-3884-4e4d-b032-4c277464398e None admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:13:11.295122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052dc231-3884-4e4d-b032-4c277464398e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:13:11.296128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dc231-3884-4e4d-b032-4c277464398e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:13:11.298439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052dc231-3884-4e4d-b032-4c277464398e None admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:13:11.327105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 657/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:13:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:13:21.145520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=30 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:13:21.322599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:14.359181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436fde-8bf2-4f28-b6be-22ccce77cd00 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:14.359773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436fde-8bf2-4f28-b6be-22ccce77cd00 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:14.359773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d436fde-8bf2-4f28-b6be-22ccce77cd00 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:14.361859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 650/1307] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:14.366991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732a07-05e6-4a16-8c7e-59a3d8696da4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:14.367489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732a07-05e6-4a16-8c7e-59a3d8696da4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:14.367584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c732a07-05e6-4a16-8c7e-59a3d8696da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:14.545832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4c732a07-05e6-4a16-8c7e-59a3d8696da4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:14.547433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4c732a07-05e6-4a16-8c7e-59a3d8696da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:14.739267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 658/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:14.802229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46107-ba4e-4dc5-9de4-846c0e12ac97 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:14.802509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46107-ba4e-4dc5-9de4-846c0e12ac97 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:14.802814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46107-ba4e-4dc5-9de4-846c0e12ac97 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:14.804356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 651/1309] 10.222.0.60 () {54 vars in 965 bytes} [Tue Aug 9 12:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:14.811175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e1ba-7759-49cc-9fa0-492fd38b35bb None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:14.811779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e1ba-7759-49cc-9fa0-492fd38b35bb None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:14.812258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687e1ba-7759-49cc-9fa0-492fd38b35bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:14.942748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5687e1ba-7759-49cc-9fa0-492fd38b35bb None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:14.943970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5687e1ba-7759-49cc-9fa0-492fd38b35bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:15.001717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:15.065805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 659/1310] 10.222.0.60 () {58 vars in 1062 bytes} [Tue Aug 9 12:14:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:15.074961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46107-ba4e-4dc5-9de4-846c0e12ac97 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:15.076796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-87d46107-ba4e-4dc5-9de4-846c0e12ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:15.214796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46107-ba4e-4dc5-9de4-846c0e12ac97 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:15.305048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:15.305796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:15.306071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:15.306336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:15.307959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:15.369308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:15.435189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:15.436697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea080a06-7233-4a18-a92a-9f86255a1ea5 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:15.458154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 652/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:17.794854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70f21-9a81-4992-a192-36232d42ca9b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:17.795401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70f21-9a81-4992-a192-36232d42ca9b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:17.795495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e70f21-9a81-4992-a192-36232d42ca9b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:17.796918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 660/1312] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:17.802202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb185b-a1fd-4cf1-a659-0de5a1773982 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:17.802657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb185b-a1fd-4cf1-a659-0de5a1773982 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:17.802772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb185b-a1fd-4cf1-a659-0de5a1773982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:17.873570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-46eb185b-a1fd-4cf1-a659-0de5a1773982 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:17.874763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-46eb185b-a1fd-4cf1-a659-0de5a1773982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:17.986504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 653/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:18.040054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6312-4358-4736-84c6-848a981c9842 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:18.040317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6312-4358-4736-84c6-848a981c9842 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:18.040585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6312-4358-4736-84c6-848a981c9842 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:18.041937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 661/1314] 10.222.0.60 () {54 vars in 965 bytes} [Tue Aug 9 12:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:18.049385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb89aa-886a-45cb-8df2-009d3023b2a2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:18.049385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb89aa-886a-45cb-8df2-009d3023b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:18.049385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb89aa-886a-45cb-8df2-009d3023b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:18.061446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:18.127884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-eecb89aa-886a-45cb-8df2-009d3023b2a2 None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:18.129153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-eecb89aa-886a-45cb-8df2-009d3023b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:18.209387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 654/1315] 10.222.0.60 () {58 vars in 1062 bytes} [Tue Aug 9 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:18.218711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6312-4358-4736-84c6-848a981c9842 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:18.220247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-996e6312-4358-4736-84c6-848a981c9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:18.330252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6312-4358-4736-84c6-848a981c9842 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:18.407896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:18.412550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:18.414033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:18.414775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:18.415625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:18.418334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:18.548926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:18.550435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57327bc-bc93-4280-a7ac-426a6d1b5ff7 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:18.571367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 662/1316] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:21.087294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437990e9-0714-45d6-ae00-5bbea7166766 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:21.087859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437990e9-0714-45d6-ae00-5bbea7166766 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:21.087859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437990e9-0714-45d6-ae00-5bbea7166766 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:21.089210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 655/1317] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:21.095813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53b2e3-836f-43aa-ac1a-ec88c1e8ef24 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:21.096561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53b2e3-836f-43aa-ac1a-ec88c1e8ef24 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:21.096713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53b2e3-836f-43aa-ac1a-ec88c1e8ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:21.173655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-be53b2e3-836f-43aa-ac1a-ec88c1e8ef24 None None] MFA Rules not processed for user `18129a6b85244d64a5bd0a61709b90f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:21.174796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-be53b2e3-836f-43aa-ac1a-ec88c1e8ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:21.229443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:21.275115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 663/1318] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:21.325785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437990e9-0714-45d6-ae00-5bbea7166766 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:21.327313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-437990e9-0714-45d6-ae00-5bbea7166766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:21.451212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437990e9-0714-45d6-ae00-5bbea7166766 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:21.455477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:21.534003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:21.534600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:21.534874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:21.535132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:21.536777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:21.659824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:21.661279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034d4ba-b244-446e-8e15-79732e74ddfd service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:21.679950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 656/1319] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:14:24.252964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ad65-9215-4f7a-a0f3-2f7729396351 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:24.253818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ad65-9215-4f7a-a0f3-2f7729396351 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:24.253818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ad65-9215-4f7a-a0f3-2f7729396351 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:24.256005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 664/1320] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:24.264311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc9418-4213-4469-9d2a-5b0d611e4d7e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:24.264794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc9418-4213-4469-9d2a-5b0d611e4d7e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:24.264889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc9418-4213-4469-9d2a-5b0d611e4d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:24.309816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:24.336882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c4cc9418-4213-4469-9d2a-5b0d611e4d7e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:24.338092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c4cc9418-4213-4469-9d2a-5b0d611e4d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:24.437090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 657/1321] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:24.479900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8ad65-9215-4f7a-a0f3-2f7729396351 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:24.481501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-18d8ad65-9215-4f7a-a0f3-2f7729396351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:24.592504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8ad65-9215-4f7a-a0f3-2f7729396351 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:24.671593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:24.672197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:24.672502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:24.672768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:24.674642 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:24.682184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:24.797698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:24.799194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd1f37-887f-4caa-9ed1-781827fbd3a3 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:24.818167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 665/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:14:27.731905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c5ca-0243-4ea6-9acd-e163244d5cc8 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:27.732470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c5ca-0243-4ea6-9acd-e163244d5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:27.732470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c5ca-0243-4ea6-9acd-e163244d5cc8 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:27.733715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 658/1323] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:27.739356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7026b-c32a-4812-8bef-dccca6fa07ec None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:27.739834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7026b-c32a-4812-8bef-dccca6fa07ec None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:27.739929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7026b-c32a-4812-8bef-dccca6fa07ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:27.806148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-18f7026b-c32a-4812-8bef-dccca6fa07ec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:27.807345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-18f7026b-c32a-4812-8bef-dccca6fa07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:27.868102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:27.912426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 666/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:27.949127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c5ca-0243-4ea6-9acd-e163244d5cc8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:27.950756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c9c2c5ca-0243-4ea6-9acd-e163244d5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:28.067354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c5ca-0243-4ea6-9acd-e163244d5cc8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:28.080307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:28.144518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:28.145121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:28.145374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:28.145632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:28.147209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:28.259808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:28.261369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d11308-a2e8-4934-a3b5-5a192fd7fbfd service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:28.280502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 659/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:30.377004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba64e-b089-40e9-b5d9-2849d65081db None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:30.377564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba64e-b089-40e9-b5d9-2849d65081db None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:30.377564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba64e-b089-40e9-b5d9-2849d65081db None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:30.378875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 667/1326] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:30.384321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e25afe-5998-4cfe-b222-c0fa37c7ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:30.384788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e25afe-5998-4cfe-b222-c0fa37c7ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:30.384894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e25afe-5998-4cfe-b222-c0fa37c7ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:30.435634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:30.454598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-62e25afe-5998-4cfe-b222-c0fa37c7ffe4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:30.455813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-62e25afe-5998-4cfe-b222-c0fa37c7ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:30.558252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 660/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:30.594248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba64e-b089-40e9-b5d9-2849d65081db None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:30.595981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ac6ba64e-b089-40e9-b5d9-2849d65081db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:30.705738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba64e-b089-40e9-b5d9-2849d65081db None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:30.784694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:30.785304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:30.785581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:30.785849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:30.787441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:30.805560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:30.910219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:30.911676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660bdad-17ed-4261-a428-09bd69c3d50c service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:30.930135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 668/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:32.990796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88225c2-d0e0-4199-82ac-806b2e892984 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:32.991401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88225c2-d0e0-4199-82ac-806b2e892984 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:32.991401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88225c2-d0e0-4199-82ac-806b2e892984 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:32.992855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 661/1329] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:32.998552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ae4f9-c246-45de-88dc-e66dcd648dc9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:32.999016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ae4f9-c246-45de-88dc-e66dcd648dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:32.999016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ae4f9-c246-45de-88dc-e66dcd648dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:33.070355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7b1ae4f9-c246-45de-88dc-e66dcd648dc9 None None] MFA Rules not processed for user `18129a6b85244d64a5bd0a61709b90f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:33.071607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7b1ae4f9-c246-45de-88dc-e66dcd648dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:33.143432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:33.178069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 669/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:14:33.216653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88225c2-d0e0-4199-82ac-806b2e892984 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:33.218187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e88225c2-d0e0-4199-82ac-806b2e892984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:33.330049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88225c2-d0e0-4199-82ac-806b2e892984 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:33.350376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:33.405804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:33.406447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:33.406722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:33.407011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:33.408633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:33.538334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:33.539835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdcedad-02a8-42c9-8ad7-2f85346ba8ee service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:33.560899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 662/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:35.831350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c69c1-ffb8-4362-981b-f08d30c93e58 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:35.831956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c69c1-ffb8-4362-981b-f08d30c93e58 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:35.831956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c69c1-ffb8-4362-981b-f08d30c93e58 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:35.833299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 670/1332] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:35.839541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b331ec-1f11-47de-9dcf-e0656afeb271 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:35.840251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b331ec-1f11-47de-9dcf-e0656afeb271 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:35.840468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b331ec-1f11-47de-9dcf-e0656afeb271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:35.911873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:35.914787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d0b331ec-1f11-47de-9dcf-e0656afeb271 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:35.916518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d0b331ec-1f11-47de-9dcf-e0656afeb271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:36.013936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 663/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:36.052089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c69c1-ffb8-4362-981b-f08d30c93e58 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:36.053669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9a4c69c1-ffb8-4362-981b-f08d30c93e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:36.182493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c69c1-ffb8-4362-981b-f08d30c93e58 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:36.259859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:36.260517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:36.260798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:36.261062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:36.262982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:36.290444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:36.376355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:36.377826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f0e1f-1378-4281-a638-979737b195f0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:36.397649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 671/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:38.449913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc28ea-46bf-4866-8902-fefe6356b4f1 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:38.450538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc28ea-46bf-4866-8902-fefe6356b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:38.450538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc28ea-46bf-4866-8902-fefe6356b4f1 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:38.451800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 664/1335] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:38.457514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f09e-6a86-490f-9199-f1e29580400e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:38.457970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f09e-6a86-490f-9199-f1e29580400e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:38.458066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f09e-6a86-490f-9199-f1e29580400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:38.531346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-10e6f09e-6a86-490f-9199-f1e29580400e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:38.532610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-10e6f09e-6a86-490f-9199-f1e29580400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:38.612979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:38.636190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 672/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:38.684266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc28ea-46bf-4866-8902-fefe6356b4f1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:38.686806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5cbc28ea-46bf-4866-8902-fefe6356b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:38.804254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc28ea-46bf-4866-8902-fefe6356b4f1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:38.833855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:38.878744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:38.879263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:38.879520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:38.879808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:38.881436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:38.994716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:38.996132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624af46-baee-4f4a-85cc-c14ea2332e02 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:39.016286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 665/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:41.447690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3958f5-af9c-4963-81d5-72dd09297dc7 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:41.448274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3958f5-af9c-4963-81d5-72dd09297dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:41.448274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3958f5-af9c-4963-81d5-72dd09297dc7 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:41.449707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 673/1338] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:41.456070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ddc9-6692-49b3-9326-790e604be428 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:41.456481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ddc9-6692-49b3-9326-790e604be428 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:41.456659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832ddc9-6692-49b3-9326-790e604be428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:41.535215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a832ddc9-6692-49b3-9326-790e604be428 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:41.536472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a832ddc9-6692-49b3-9326-790e604be428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:41.544836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:41.645015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 666/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:41.683890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3958f5-af9c-4963-81d5-72dd09297dc7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:41.685527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6f3958f5-af9c-4963-81d5-72dd09297dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:41.804851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3958f5-af9c-4963-81d5-72dd09297dc7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:41.889204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:41.890016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:41.890402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:41.890816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:41.893481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:41.936131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:42.011897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:42.013737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adaa8d3-c731-4d05-8413-bb58814a4744 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:42.032521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 674/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:46.034612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273920ea-2c24-4321-97c5-46b5bfbcf087 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:46.035222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273920ea-2c24-4321-97c5-46b5bfbcf087 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:46.035222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273920ea-2c24-4321-97c5-46b5bfbcf087 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:46.036527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 667/1341] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:46.041750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e8567-950d-4175-8a41-b403415f10d9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:46.042182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e8567-950d-4175-8a41-b403415f10d9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:46.042284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e8567-950d-4175-8a41-b403415f10d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:46.109650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fe8e8567-950d-4175-8a41-b403415f10d9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:46.111161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fe8e8567-950d-4175-8a41-b403415f10d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:46.198537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:46.211620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 675/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:46.252009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273920ea-2c24-4321-97c5-46b5bfbcf087 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:46.253579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-273920ea-2c24-4321-97c5-46b5bfbcf087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:46.367273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273920ea-2c24-4321-97c5-46b5bfbcf087 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:46.404205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:46.440641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:46.441240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:46.441508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:46.441764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:46.443327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:46.553850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:46.555281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e48c-277f-46d2-bcf9-935abd5a6593 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:46.574276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 668/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:49.159350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8f0d-10c4-4220-9bab-6087f123e97c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:49.159892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8f0d-10c4-4220-9bab-6087f123e97c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:49.159892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8f0d-10c4-4220-9bab-6087f123e97c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:49.161275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 676/1344] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:49.167203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f962-363d-494b-8564-8a29d3241ba6 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:49.167727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f962-363d-494b-8564-8a29d3241ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:49.167727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5f962-363d-494b-8564-8a29d3241ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:49.242395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c2a5f962-363d-494b-8564-8a29d3241ba6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:49.243631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c2a5f962-363d-494b-8564-8a29d3241ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:49.265352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:49.352063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 669/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:49.390614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8f0d-10c4-4220-9bab-6087f123e97c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:49.392176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-780f8f0d-10c4-4220-9bab-6087f123e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:49.497450 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8f0d-10c4-4220-9bab-6087f123e97c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:49.573649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:49.574164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:49.574435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:49.574696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:49.576286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:49.620770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:49.692717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:49.694196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3884b61-179a-4d8a-879d-31d6e72a26dc service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:49.714683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 677/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:54.076366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9783d-9f59-4965-8d6d-370023594c2a None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:54.076965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9783d-9f59-4965-8d6d-370023594c2a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:54.076965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9783d-9f59-4965-8d6d-370023594c2a None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:54.079139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 670/1347] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:14:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:54.085041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed776-5f0c-41a4-9edb-0d3326445d0c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:54.085556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed776-5f0c-41a4-9edb-0d3326445d0c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:54.085556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bed776-5f0c-41a4-9edb-0d3326445d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:54.159867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-03bed776-5f0c-41a4-9edb-0d3326445d0c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:54.161131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-03bed776-5f0c-41a4-9edb-0d3326445d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:54.262314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:54.272409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 678/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:14:54.304536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9783d-9f59-4965-8d6d-370023594c2a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:14:54.306125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c6e9783d-9f59-4965-8d6d-370023594c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:54.428849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9783d-9f59-4965-8d6d-370023594c2a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:14:54.482632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:54.511714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:14:54.512747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:54.513033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:54.513276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:54.514930 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:54.640205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:14:54.641899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e575f2-0982-48b3-affc-ca3b7dc31b04 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:14:54.661388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 671/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:14:59.657466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6f543-ca9b-482d-bad0-6631fb9fb9b3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:59.657466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6f543-ca9b-482d-bad0-6631fb9fb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:59.657466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6f543-ca9b-482d-bad0-6631fb9fb9b3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:59.658125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 679/1350] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:14:59.663276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb340c-8167-4327-a82f-972e413eb552 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:14:59.663739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb340c-8167-4327-a82f-972e413eb552 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:14:59.663844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb340c-8167-4327-a82f-972e413eb552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:14:59.744284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0edb340c-8167-4327-a82f-972e413eb552 None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:14:59.745514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0edb340c-8167-4327-a82f-972e413eb552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:14:59.783643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:14:59.860306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 672/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:14:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:03.923398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dece6d-4a4b-4c5f-98ea-ca348a4e3630 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:03.923990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dece6d-4a4b-4c5f-98ea-ca348a4e3630 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:03.923990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dece6d-4a4b-4c5f-98ea-ca348a4e3630 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:03.925305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 680/1352] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:03.930529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2750-5076-4956-b925-41b8fb814cc5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:03.930965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2750-5076-4956-b925-41b8fb814cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:03.931142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb2750-5076-4956-b925-41b8fb814cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:04.011967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-64fb2750-5076-4956-b925-41b8fb814cc5 None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:04.013220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-64fb2750-5076-4956-b925-41b8fb814cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:04.091595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:04.139412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 673/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:05.324311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570451c9-95b7-492f-b019-3f4d695d3ea0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:05.324952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570451c9-95b7-492f-b019-3f4d695d3ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:05.324952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570451c9-95b7-492f-b019-3f4d695d3ea0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:05.326245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 681/1354] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:05.331808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd6a9-70cc-4437-b807-55982f034159 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:05.332303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd6a9-70cc-4437-b807-55982f034159 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:05.332303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd6a9-70cc-4437-b807-55982f034159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:05.413875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-aeadd6a9-70cc-4437-b807-55982f034159 None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:05.415069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-aeadd6a9-70cc-4437-b807-55982f034159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:05.521074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 674/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:15:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:09.059151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d160-878b-43df-baf1-e240ae4fa408 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.059986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d160-878b-43df-baf1-e240ae4fa408 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.060502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d160-878b-43df-baf1-e240ae4fa408 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.062199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 682/1356] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:09.070860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fe04-c805-4641-bdd1-385dd302f25e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.070860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fe04-c805-4641-bdd1-385dd302f25e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.070860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3fe04-c805-4641-bdd1-385dd302f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.107291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.144046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-67a3fe04-c805-4641-bdd1-385dd302f25e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:09.145186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-67a3fe04-c805-4641-bdd1-385dd302f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.252425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 675/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:09.301791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9bbb3-c50e-4e02-84b4-28295c0fa2e4 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.302281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9bbb3-c50e-4e02-84b4-28295c0fa2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.302729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9bbb3-c50e-4e02-84b4-28295c0fa2e4 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.304257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 683/1358] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 9 12:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:09.314941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c042fa5-b3c3-4646-9210-a9ebd8cc474a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.315460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c042fa5-b3c3-4646-9210-a9ebd8cc474a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.316372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c042fa5-b3c3-4646-9210-a9ebd8cc474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.397963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2c042fa5-b3c3-4646-9210-a9ebd8cc474a None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:09.399227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2c042fa5-b3c3-4646-9210-a9ebd8cc474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.450625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.521992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 676/1359] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 9 12:15:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:09.530031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9bbb3-c50e-4e02-84b4-28295c0fa2e4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:09.531646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-07b9bbb3-c50e-4e02-84b4-28295c0fa2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.689971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9bbb3-c50e-4e02-84b4-28295c0fa2e4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:09.764650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:09.809857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:09.810640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:09.811163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:09.811518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:09.813241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:09.907457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:09.909346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7e9f35-700c-4943-8614-acb0032cd388 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:09.928494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 684/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:12.174719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f3c4-1646-466c-9e34-6405435c6b18 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:12.175267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f3c4-1646-466c-9e34-6405435c6b18 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:12.175542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f3c4-1646-466c-9e34-6405435c6b18 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:12.177224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 677/1361] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:12.182766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb3b04-5420-41bb-9f36-aba549b4cf1e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:12.183225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb3b04-5420-41bb-9f36-aba549b4cf1e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:12.183329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb3b04-5420-41bb-9f36-aba549b4cf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:12.255679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8ecb3b04-5420-41bb-9f36-aba549b4cf1e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:12.256928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8ecb3b04-5420-41bb-9f36-aba549b4cf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:12.295814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:12.366333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 685/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:12.411804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855f3c4-1646-466c-9e34-6405435c6b18 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:12.413344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9855f3c4-1646-466c-9e34-6405435c6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:12.596659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855f3c4-1646-466c-9e34-6405435c6b18 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:12.607494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:12.730616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:12.731340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:12.731666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:12.731990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:12.733668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:12.825808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:12.827388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401b086-9d22-43de-adea-0fb9d6d87920 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:12.846724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 678/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:15.187599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c5472-5767-4dfb-abe4-dbbd3588f3ea None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:15.188133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c5472-5767-4dfb-abe4-dbbd3588f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:15.188133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c5472-5767-4dfb-abe4-dbbd3588f3ea None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:15.189721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 686/1364] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:15.194927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f61ea-3066-4500-a75b-ff3e74b7a553 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:15.195343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f61ea-3066-4500-a75b-ff3e74b7a553 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:15.195472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f61ea-3066-4500-a75b-ff3e74b7a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:15.218527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:15.274892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-412f61ea-3066-4500-a75b-ff3e74b7a553 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:15.276113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-412f61ea-3066-4500-a75b-ff3e74b7a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:15.384440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 679/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:15.430054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e2023-439c-40c6-95ee-f076006cc80c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:15.430342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e2023-439c-40c6-95ee-f076006cc80c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:15.430613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e2023-439c-40c6-95ee-f076006cc80c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:15.432002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 687/1366] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 9 12:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:15.437779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dcac5-790a-4e9b-9961-9fd29f42ca87 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:15.437959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dcac5-790a-4e9b-9961-9fd29f42ca87 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:15.438229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dcac5-790a-4e9b-9961-9fd29f42ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:15.541202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4f9dcac5-790a-4e9b-9961-9fd29f42ca87 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:15.542423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4f9dcac5-790a-4e9b-9961-9fd29f42ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:15.580740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:15.683928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 680/1367] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 9 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:15.690631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e2023-439c-40c6-95ee-f076006cc80c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:15.692127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d29e2023-439c-40c6-95ee-f076006cc80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:15.847514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e2023-439c-40c6-95ee-f076006cc80c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:15.868518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:15.969273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:15.969783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:15.970058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:15.970324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:15.971914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:16.068444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:16.070096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e8f7-ae45-40e7-8f35-c5bd4bddcf3c service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:16.089039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 688/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:17.051437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78824f04-5f7c-48df-8f64-438c8c7f2fde None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:17.052049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78824f04-5f7c-48df-8f64-438c8c7f2fde None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:17.052049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78824f04-5f7c-48df-8f64-438c8c7f2fde None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:17.053553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 681/1369] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:17.064827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85d347-7542-48aa-b6ca-13cb0f694313 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:17.065344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85d347-7542-48aa-b6ca-13cb0f694313 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:17.065344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85d347-7542-48aa-b6ca-13cb0f694313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:17.097785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:17.135001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1d85d347-7542-48aa-b6ca-13cb0f694313 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:17.136240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1d85d347-7542-48aa-b6ca-13cb0f694313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:17.236213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 689/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:17.584685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38174-c467-46d3-865a-7defff9eb070 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:17.584685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38174-c467-46d3-865a-7defff9eb070 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:17.584685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38174-c467-46d3-865a-7defff9eb070 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:17.584685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 682/1371] 10.222.0.60 () {54 vars in 964 bytes} [Tue Aug 9 12:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:17.588432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d6621-83da-421a-a2ce-182eaa9ffe6e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:17.588721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d6621-83da-421a-a2ce-182eaa9ffe6e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:17.589009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d6621-83da-421a-a2ce-182eaa9ffe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:17.673723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6f9d6621-83da-421a-a2ce-182eaa9ffe6e None None] MFA Rules not processed for user `f1157b842770470fb1bc61297ae0e2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:17.674948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6f9d6621-83da-421a-a2ce-182eaa9ffe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:17.725892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:17.764549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 690/1372] 10.222.0.60 () {58 vars in 1061 bytes} [Tue Aug 9 12:15:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:17.766524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f38174-c467-46d3-865a-7defff9eb070 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:17.768041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-63f38174-c467-46d3-865a-7defff9eb070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:17.887248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f38174-c467-46d3-865a-7defff9eb070 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:17.933224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:17.969847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:17.970606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:17.970875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:17.971135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:17.972800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:18.097896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:18.099311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55084a7-f2eb-4ee2-bf4b-67869b0cecd5 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:18.119326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 683/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:15:18.226836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5328e-e39b-42db-9a60-a5b8b53bd30b None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:18.227371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5328e-e39b-42db-9a60-a5b8b53bd30b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:18.227371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5328e-e39b-42db-9a60-a5b8b53bd30b None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:18.228946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 691/1374] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:18.237065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f31cc4-5746-4372-b915-aeb2bec0d6b4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:18.237065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f31cc4-5746-4372-b915-aeb2bec0d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:18.237065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f31cc4-5746-4372-b915-aeb2bec0d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:18.303363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-65f31cc4-5746-4372-b915-aeb2bec0d6b4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:18.304627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-65f31cc4-5746-4372-b915-aeb2bec0d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:18.325542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:18.443897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 684/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:18.489093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5328e-e39b-42db-9a60-a5b8b53bd30b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:18.490721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c4b5328e-e39b-42db-9a60-a5b8b53bd30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:18.644582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5328e-e39b-42db-9a60-a5b8b53bd30b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:18.696159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:18.762946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:18.763578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:18.763858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:18.764107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:18.765890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:18.863373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:18.865074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89b61e-54fb-40d6-b680-ec34c725341a service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:18.884154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 692/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:20.908612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c9623-7a4d-4567-83c1-6c47b77bec87 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:20.909174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c9623-7a4d-4567-83c1-6c47b77bec87 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:20.909174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c9623-7a4d-4567-83c1-6c47b77bec87 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:20.910491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 685/1377] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:20.915656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10236-b61f-4bfa-9a4e-e45600ef2a00 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:20.916088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10236-b61f-4bfa-9a4e-e45600ef2a00 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:20.916195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af10236-b61f-4bfa-9a4e-e45600ef2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:20.980924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0af10236-b61f-4bfa-9a4e-e45600ef2a00 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:20.982144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0af10236-b61f-4bfa-9a4e-e45600ef2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:20.995108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:21.098027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 693/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:21.143249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c9623-7a4d-4567-83c1-6c47b77bec87 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:21.150760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-485c9623-7a4d-4567-83c1-6c47b77bec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:21.316808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c9623-7a4d-4567-83c1-6c47b77bec87 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:21.320339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:21.441802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:21.442332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:21.442602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:21.442864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:21.444493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:21.557470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:21.559064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae9460-6411-4d20-a894-d84237440295 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:21.579090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 686/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:23.652260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaef69-91bf-4210-95d2-1cb6cb898ef5 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:23.652893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaef69-91bf-4210-95d2-1cb6cb898ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:23.652893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaef69-91bf-4210-95d2-1cb6cb898ef5 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:23.654379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 694/1380] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:23.660553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677b39f-42d9-4c80-b00f-c030046f1555 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:23.661162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677b39f-42d9-4c80-b00f-c030046f1555 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:23.661162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677b39f-42d9-4c80-b00f-c030046f1555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:23.674407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:23.736415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c677b39f-42d9-4c80-b00f-c030046f1555 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:23.737797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c677b39f-42d9-4c80-b00f-c030046f1555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:23.839823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 687/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:23.889374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaef69-91bf-4210-95d2-1cb6cb898ef5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:23.891388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4ecaef69-91bf-4210-95d2-1cb6cb898ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:24.040443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:24.052799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaef69-91bf-4210-95d2-1cb6cb898ef5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:24.173243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:24.173850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:24.174195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:24.174545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:24.176191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:24.271061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:24.272827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44812cb0-cb11-4964-862f-e38a603cf244 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:24.284141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:24.293912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 695/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:26.362927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac584dc-0a89-43ba-a3a7-25d09f661faa None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:26.363618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac584dc-0a89-43ba-a3a7-25d09f661faa None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:26.363618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac584dc-0a89-43ba-a3a7-25d09f661faa None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:26.364941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 688/1383] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:26.370553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e027d0-4282-4713-9707-27d4eef2565c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:26.371035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e027d0-4282-4713-9707-27d4eef2565c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:26.371180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e027d0-4282-4713-9707-27d4eef2565c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:26.437626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-38e027d0-4282-4713-9707-27d4eef2565c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:26.438918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-38e027d0-4282-4713-9707-27d4eef2565c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:26.542664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 696/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:15:26.590255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac584dc-0a89-43ba-a3a7-25d09f661faa None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:26.591931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-eac584dc-0a89-43ba-a3a7-25d09f661faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:26.681423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:26.752893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac584dc-0a89-43ba-a3a7-25d09f661faa None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:26.884703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:26.885196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:26.885468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:26.885732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:26.887681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:26.939678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:26.982293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:26.983944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166e134-7e1f-4c28-b7ef-d0abe042120f service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:27.002968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 689/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:29.213609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b9c80-48f2-4a0d-a2ca-9c681b53535f None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:29.214150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b9c80-48f2-4a0d-a2ca-9c681b53535f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:29.214346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b9c80-48f2-4a0d-a2ca-9c681b53535f None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:29.216568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 697/1386] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:29.222249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5987af-ddd7-4c31-a2b9-e3930cd31b3f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:29.222742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5987af-ddd7-4c31-a2b9-e3930cd31b3f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:29.222845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5987af-ddd7-4c31-a2b9-e3930cd31b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:29.296551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9f5987af-ddd7-4c31-a2b9-e3930cd31b3f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:29.297780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9f5987af-ddd7-4c31-a2b9-e3930cd31b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:29.402319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 690/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:29.456414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b9c80-48f2-4a0d-a2ca-9c681b53535f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:29.458389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dc2b9c80-48f2-4a0d-a2ca-9c681b53535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:29.542527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:29.635600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b9c80-48f2-4a0d-a2ca-9c681b53535f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:29.776036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:29.776913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:29.777316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:29.777719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:29.780632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:29.828482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:29.885324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:29.887320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acbfff-c1e0-48f0-9014-fa83377df8e8 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:29.906562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 698/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:31.943400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179288-debb-4bd9-8f71-f0d0fbf0f265 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:31.943938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179288-debb-4bd9-8f71-f0d0fbf0f265 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:31.943938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98179288-debb-4bd9-8f71-f0d0fbf0f265 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:31.945314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 691/1389] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:31.950801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99bddb-f4a0-493c-8247-5e7465d87b2f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:31.951210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99bddb-f4a0-493c-8247-5e7465d87b2f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:31.951306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99bddb-f4a0-493c-8247-5e7465d87b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:32.019030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6b99bddb-f4a0-493c-8247-5e7465d87b2f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:32.020236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6b99bddb-f4a0-493c-8247-5e7465d87b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:32.117545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 699/1390] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:32.163291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98179288-debb-4bd9-8f71-f0d0fbf0f265 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:32.164912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-98179288-debb-4bd9-8f71-f0d0fbf0f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:32.196554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:32.310321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98179288-debb-4bd9-8f71-f0d0fbf0f265 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:32.415837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:32.427715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:32.428325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:32.428629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:32.428894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:32.430497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:32.523053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:32.524705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9f762-4931-4b86-9616-1a562ad0a79b service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:32.542978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 692/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:33.813808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9798-5c5a-49d6-a2e2-85381ce9a6cf None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:33.814671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9798-5c5a-49d6-a2e2-85381ce9a6cf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:33.814671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db9798-5c5a-49d6-a2e2-85381ce9a6cf None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:33.816253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 700/1392] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:33.821601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e78dd-4f62-477e-9757-0e202adb4cc7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:33.822037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e78dd-4f62-477e-9757-0e202adb4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:33.822126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e78dd-4f62-477e-9757-0e202adb4cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:33.893339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-cb7e78dd-4f62-477e-9757-0e202adb4cc7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:33.894566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-cb7e78dd-4f62-477e-9757-0e202adb4cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:33.951946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:33.991007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 693/1393] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:34.047521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693626c5-3f85-45b7-bbb1-441ae2df5b09 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:34.047804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693626c5-3f85-45b7-bbb1-441ae2df5b09 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:34.048072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693626c5-3f85-45b7-bbb1-441ae2df5b09 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:34.049497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 701/1394] 10.222.0.60 () {54 vars in 967 bytes} [Tue Aug 9 12:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:34.054906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cad61-2831-4b91-99c2-02b903b42237 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:34.055186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cad61-2831-4b91-99c2-02b903b42237 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:34.055455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cad61-2831-4b91-99c2-02b903b42237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:34.133527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2e7cad61-2831-4b91-99c2-02b903b42237 None None] MFA Rules not processed for user `cf3acf73742b49409bfc4128386a3302`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:34.134726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2e7cad61-2831-4b91-99c2-02b903b42237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:34.216714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 694/1395] 10.222.0.60 () {58 vars in 1064 bytes} [Tue Aug 9 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:34.224592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693626c5-3f85-45b7-bbb1-441ae2df5b09 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:34.226075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-693626c5-3f85-45b7-bbb1-441ae2df5b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:34.247988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:34.342986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693626c5-3f85-45b7-bbb1-441ae2df5b09 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:34.421428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:34.422031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:34.422302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:34.422548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:34.424114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:34.493527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:34.535588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:34.537062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4fd23-8bfa-42f4-b19f-d96380951138 service glance] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:34.555888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 702/1396] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:15:34.591736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f29348-5bf1-4a5c-bb86-26eda32525e9 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:34.592070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f29348-5bf1-4a5c-bb86-26eda32525e9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:34.592360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f29348-5bf1-4a5c-bb86-26eda32525e9 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:34.593880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 695/1397] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:34.599370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8aa61-ffca-45ab-8900-79ab4766f052 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:34.599781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8aa61-ffca-45ab-8900-79ab4766f052 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:34.600055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8aa61-ffca-45ab-8900-79ab4766f052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:34.669564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0ad8aa61-ffca-45ab-8900-79ab4766f052 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:34.670817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0ad8aa61-ffca-45ab-8900-79ab4766f052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:34.772527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 703/1398] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:34.818800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f29348-5bf1-4a5c-bb86-26eda32525e9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:34.820339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-61f29348-5bf1-4a5c-bb86-26eda32525e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:34.893451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:34.999811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f29348-5bf1-4a5c-bb86-26eda32525e9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:35.113085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:35.113696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:35.113961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:35.114219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:35.115814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:35.138978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:35.214676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:35.216288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58271a8-5e58-46f7-a948-4053b785613c service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:35.236603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 696/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:35.306479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c7a56-f6af-40b7-9a97-4a8fe990812a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:35.307018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c7a56-f6af-40b7-9a97-4a8fe990812a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:35.307124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c7a56-f6af-40b7-9a97-4a8fe990812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:35.343108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:35.390117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-950c7a56-f6af-40b7-9a97-4a8fe990812a None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:35.391449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-950c7a56-f6af-40b7-9a97-4a8fe990812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:35.492309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 704/1400] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:15:35.534127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae932-385e-4090-9168-5bd775546bde None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:35.534384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae932-385e-4090-9168-5bd775546bde None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:35.534705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adae932-385e-4090-9168-5bd775546bde None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:35.536087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 697/1401] 10.222.0.60 () {54 vars in 943 bytes} [Tue Aug 9 12:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:35.542341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7191-2f34-4d6c-96f5-cd69b6cfae63 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:35.542680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7191-2f34-4d6c-96f5-cd69b6cfae63 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:35.542898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7191-2f34-4d6c-96f5-cd69b6cfae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:35.618573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-320d7191-2f34-4d6c-96f5-cd69b6cfae63 None None] MFA Rules not processed for user `f3b5cb27f7e64ea1b3a04dc71d1d36aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:35.619781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-320d7191-2f34-4d6c-96f5-cd69b6cfae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:35.675311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:35.730786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 705/1402] 10.222.0.60 () {58 vars in 1040 bytes} [Tue Aug 9 12:15:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:35.740177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae932-385e-4090-9168-5bd775546bde None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:35.741727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5adae932-385e-4090-9168-5bd775546bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:35.888995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adae932-385e-4090-9168-5bd775546bde None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:35.901390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:35.995236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:35.995846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:35.996117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:35.996407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:35.998040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:36.081257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:36.082856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443904b4-54e8-4118-8b5f-9ff470101550 service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:36.090811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 698/1403] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:15:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:15:37.300877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5fd21-cd30-490f-9abf-16a14c31ba15 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:37.301522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5fd21-cd30-490f-9abf-16a14c31ba15 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:37.301522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5fd21-cd30-490f-9abf-16a14c31ba15 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:37.302817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 706/1404] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:37.308796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee084-4da0-4c7f-8a75-56e2a2fdfe9f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:37.309593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee084-4da0-4c7f-8a75-56e2a2fdfe9f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:37.309873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ee084-4da0-4c7f-8a75-56e2a2fdfe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:37.368301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:37.389895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-331ee084-4da0-4c7f-8a75-56e2a2fdfe9f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:37.391275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-331ee084-4da0-4c7f-8a75-56e2a2fdfe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:37.508866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 699/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:37.558530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5fd21-cd30-490f-9abf-16a14c31ba15 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:37.559986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a7c5fd21-cd30-490f-9abf-16a14c31ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:37.741873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5fd21-cd30-490f-9abf-16a14c31ba15 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:37.771287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:37.869619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:37.870251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:37.870583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:37.870916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:37.872597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:37.973906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:37.975822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d8b78-7603-41d1-8216-79dc93b2c5c4 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:37.996130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 707/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:40.050062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cb1f-49e1-49f8-b51e-8d643a4640ed None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:40.051140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cb1f-49e1-49f8-b51e-8d643a4640ed None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:40.051393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cb1f-49e1-49f8-b51e-8d643a4640ed None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:40.053094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 700/1407] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:15:40.058723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dea8f-d55b-455d-90d8-131f248e014d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:40.059523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dea8f-d55b-455d-90d8-131f248e014d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:40.059798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dea8f-d55b-455d-90d8-131f248e014d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:40.102293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:40.129927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f80dea8f-d55b-455d-90d8-131f248e014d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:40.131429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f80dea8f-d55b-455d-90d8-131f248e014d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:40.242743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 708/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:40.289530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4cb1f-49e1-49f8-b51e-8d643a4640ed None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:15:40.291102 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-05e4cb1f-49e1-49f8-b51e-8d643a4640ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:40.424751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:40.457256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4cb1f-49e1-49f8-b51e-8d643a4640ed None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:15:40.579700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:15:40.580255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:40.580550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:40.580818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:40.582399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:40.673159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:40.683129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:15:40.685028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698153-1081-4ee6-84d6-9427edcd1461 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:15:40.707722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 701/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:15:50.240841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=51 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:50.704239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=8 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:58.083933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4b44-193b-400e-b76f-8613ded95692 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:58.084528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4b44-193b-400e-b76f-8613ded95692 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:58.084528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4b44-193b-400e-b76f-8613ded95692 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:58.085845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 709/1410] 10.222.0.60 () {54 vars in 918 bytes} [Tue Aug 9 12:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:58.092147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d221b-b2ac-45bd-86d1-bdde7c128e09 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:58.092659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d221b-b2ac-45bd-86d1-bdde7c128e09 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:58.093451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d221b-b2ac-45bd-86d1-bdde7c128e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:58.192535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-529d221b-b2ac-45bd-86d1-bdde7c128e09 None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:58.194311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-529d221b-b2ac-45bd-86d1-bdde7c128e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:58.312023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 702/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 9 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:15:58.327732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916190b9-e8c0-4396-bfd1-1ff8d9dabc51 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:58.328017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916190b9-e8c0-4396-bfd1-1ff8d9dabc51 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:58.328291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916190b9-e8c0-4396-bfd1-1ff8d9dabc51 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:58.329682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 710/1412] 10.222.0.60 () {54 vars in 918 bytes} [Tue Aug 9 12:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:15:58.334528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fc63-d134-4194-9424-c18626f1d407 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:15:58.334804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fc63-d134-4194-9424-c18626f1d407 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:15:58.335075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0fc63-d134-4194-9424-c18626f1d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:15:58.410260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:15:58.413914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-78a0fc63-d134-4194-9424-c18626f1d407 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:15:58.416768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-78a0fc63-d134-4194-9424-c18626f1d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:15:58.543993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 703/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 9 12:15:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:16:01.028271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dca7c-126f-467e-9a06-82639b27faa9 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:01.028941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dca7c-126f-467e-9a06-82639b27faa9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:01.028941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dca7c-126f-467e-9a06-82639b27faa9 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:01.030385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:01.039457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b176b-650a-4507-8d95-cf18cb9a3f83 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:01.039897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b176b-650a-4507-8d95-cf18cb9a3f83 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:01.040018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b176b-650a-4507-8d95-cf18cb9a3f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:01.113089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-3d0b176b-650a-4507-8d95-cf18cb9a3f83 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:01.114278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3d0b176b-650a-4507-8d95-cf18cb9a3f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:01.171538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:01.222631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:01.279241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dca7c-126f-467e-9a06-82639b27faa9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:01.281099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-774dca7c-126f-467e-9a06-82639b27faa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:01.439018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dca7c-126f-467e-9a06-82639b27faa9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:01.519250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:01.572086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:01.572722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:01.572987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:01.573249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:01.574850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:01.673548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:01.675148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d1b82-00f6-45d7-9428-776650cc4c4f service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:01.693828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 712/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:02.596622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad353-a4b4-4a82-91eb-3e372f0a2527 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:02.597208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad353-a4b4-4a82-91eb-3e372f0a2527 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:02.597208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad353-a4b4-4a82-91eb-3e372f0a2527 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:02.599345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:02.607647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f0163-fb4c-4927-a651-67a3f030a5bf None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:02.608071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f0163-fb4c-4927-a651-67a3f030a5bf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:02.608288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f0163-fb4c-4927-a651-67a3f030a5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:02.691606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c97f0163-fb4c-4927-a651-67a3f030a5bf None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:02.692768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c97f0163-fb4c-4927-a651-67a3f030a5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:02.721101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:02.790826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:02.946596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad353-a4b4-4a82-91eb-3e372f0a2527 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:02.948954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-347ad353-a4b4-4a82-91eb-3e372f0a2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:03.113636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad353-a4b4-4a82-91eb-3e372f0a2527 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:03.156742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:03.238879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:03.239409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:03.239678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:03.239936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:03.241577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:03.333052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:03.334631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497cb7-876b-4e5d-9269-6dfe5babdb12 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:03.352465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 706/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:04.245037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205704a-953d-43dd-bf46-d953e8b38e96 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:04.245972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205704a-953d-43dd-bf46-d953e8b38e96 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:04.245972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205704a-953d-43dd-bf46-d953e8b38e96 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:04.247899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:04.254663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67f39-d349-4e61-9f2e-76153f1ddb80 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:04.255113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67f39-d349-4e61-9f2e-76153f1ddb80 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:04.255210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67f39-d349-4e61-9f2e-76153f1ddb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:04.329029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:04.351943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2ba67f39-d349-4e61-9f2e-76153f1ddb80 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:04.353172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2ba67f39-d349-4e61-9f2e-76153f1ddb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:04.467386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:04.621615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205704a-953d-43dd-bf46-d953e8b38e96 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:04.624582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6205704a-953d-43dd-bf46-d953e8b38e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:04.793785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205704a-953d-43dd-bf46-d953e8b38e96 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:04.807162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:04.924038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:04.924699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:04.924967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:04.925227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:04.926790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:05.021387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:05.022999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05427f-e292-4541-a755-65bf7d558aa7 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:05.043081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 715/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:05.904986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e725a-20cf-4241-8d27-a027ec886f1d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:05.905821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e725a-20cf-4241-8d27-a027ec886f1d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:05.906574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e725a-20cf-4241-8d27-a027ec886f1d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:05.907985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:05.913302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be7bb7-4b80-4cc8-912b-f86d043b1bf6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:05.913710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be7bb7-4b80-4cc8-912b-f86d043b1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:05.913908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be7bb7-4b80-4cc8-912b-f86d043b1bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:05.934463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:05.993899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-94be7bb7-4b80-4cc8-912b-f86d043b1bf6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:05.995097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94be7bb7-4b80-4cc8-912b-f86d043b1bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:06.102384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:06.253066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e725a-20cf-4241-8d27-a027ec886f1d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:06.255537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-315e725a-20cf-4241-8d27-a027ec886f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:06.391878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:06.430089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e725a-20cf-4241-8d27-a027ec886f1d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:06.560464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:06.561192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:06.561573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:06.561920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:06.563618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:06.646123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:06.663284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:06.664979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7239e1-a74f-4aa7-90be-221bec4e647d service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:06.683262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 709/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:07.563364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583fab-b675-4b8b-b5e6-4e3d47fbf871 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:07.564281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583fab-b675-4b8b-b5e6-4e3d47fbf871 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:07.564281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583fab-b675-4b8b-b5e6-4e3d47fbf871 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:07.566395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:07.574620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8350-52d7-4688-9941-1d78259f4576 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:07.575356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8350-52d7-4688-9941-1d78259f4576 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:07.575535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8350-52d7-4688-9941-1d78259f4576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:07.655313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c7dd8350-52d7-4688-9941-1d78259f4576 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:07.657069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c7dd8350-52d7-4688-9941-1d78259f4576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:07.762426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:07.923998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583fab-b675-4b8b-b5e6-4e3d47fbf871 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:07.926323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0e583fab-b675-4b8b-b5e6-4e3d47fbf871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:08.019926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:08.092947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583fab-b675-4b8b-b5e6-4e3d47fbf871 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:08.216648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:08.217143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:08.217510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:08.217829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:08.219859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:08.275654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:08.320965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:08.322599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e3bd1-5e3e-4782-a170-1de8ef2df22c service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:08.341712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 718/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:09.151656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85adc5-d163-4b7a-a125-c7714de2f2b0 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:09.152556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85adc5-d163-4b7a-a125-c7714de2f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:09.152556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85adc5-d163-4b7a-a125-c7714de2f2b0 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:09.154588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:09.163127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a8ce-e0fb-4c77-96ce-c6630402b5aa None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:09.163859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a8ce-e0fb-4c77-96ce-c6630402b5aa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:09.164012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47a8ce-e0fb-4c77-96ce-c6630402b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:09.253042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6f47a8ce-e0fb-4c77-96ce-c6630402b5aa None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:09.254246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6f47a8ce-e0fb-4c77-96ce-c6630402b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:09.359045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:09.511940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85adc5-d163-4b7a-a125-c7714de2f2b0 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:09.514386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fc85adc5-d163-4b7a-a125-c7714de2f2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:09.572993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:09.678952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85adc5-d163-4b7a-a125-c7714de2f2b0 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:09.808665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:09.809171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:09.809444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:09.809704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:09.811267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:09.818805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:09.910973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:09.912707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d2436-fd6a-432b-adbc-c084e07d3f48 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:09.932184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 712/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:10.738622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2196-9411-49f8-9146-d8f654464066 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:10.739274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2196-9411-49f8-9146-d8f654464066 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:10.739274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb2196-9411-49f8-9146-d8f654464066 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:10.740412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:10.746408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b274-fedb-425f-8bb8-8f0050a4f2a3 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:10.747122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b274-fedb-425f-8bb8-8f0050a4f2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:10.747291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03b274-fedb-425f-8bb8-8f0050a4f2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:10.828789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0a03b274-fedb-425f-8bb8-8f0050a4f2a3 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:10.829979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0a03b274-fedb-425f-8bb8-8f0050a4f2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:10.905484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:10.936632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:11.090174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2196-9411-49f8-9146-d8f654464066 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:11.092640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-aabb2196-9411-49f8-9146-d8f654464066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:11.115738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:11.255230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb2196-9411-49f8-9146-d8f654464066 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:11.347147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:11.380350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:11.380988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:11.381261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:11.381526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:11.383121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:11.480566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:11.482183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938dfd94-29b0-4444-9003-c0964977028f service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:11.502501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 721/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:12.312914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb9b3-fc2a-4ebb-9e48-ec2bee70ce3d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:12.313867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb9b3-fc2a-4ebb-9e48-ec2bee70ce3d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:12.313867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebb9b3-fc2a-4ebb-9e48-ec2bee70ce3d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:12.316012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:12.322057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490940c-07be-4a38-9abf-389873012faf None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:12.322526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490940c-07be-4a38-9abf-389873012faf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:12.322633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490940c-07be-4a38-9abf-389873012faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:12.412948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1490940c-07be-4a38-9abf-389873012faf None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:12.414171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1490940c-07be-4a38-9abf-389873012faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:12.457129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:12.514180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:12.666237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb9b3-fc2a-4ebb-9e48-ec2bee70ce3d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:12.667707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-80ebb9b3-fc2a-4ebb-9e48-ec2bee70ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:12.820948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebb9b3-fc2a-4ebb-9e48-ec2bee70ce3d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:12.887210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:12.954516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:12.955269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:12.955521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:12.955900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:12.958494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:13.063764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:13.065391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a869719-b215-4f21-9c7c-db62e32885bb service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:13.087982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 715/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:13.909085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e054-1370-4a1a-bf43-dce9575b808a None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:13.909606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e054-1370-4a1a-bf43-dce9575b808a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:13.909606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9e054-1370-4a1a-bf43-dce9575b808a None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:13.911683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:16:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:13.916953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d706a-c9fd-4149-b3da-0a287b0b61d9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:13.917491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d706a-c9fd-4149-b3da-0a287b0b61d9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:13.917491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d706a-c9fd-4149-b3da-0a287b0b61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:14.007830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c37d706a-c9fd-4149-b3da-0a287b0b61d9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:14.009090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c37d706a-c9fd-4149-b3da-0a287b0b61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:14.011405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:14.249969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:14.405426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e054-1370-4a1a-bf43-dce9575b808a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:14.407916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d7a9e054-1370-4a1a-bf43-dce9575b808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:14.570460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9e054-1370-4a1a-bf43-dce9575b808a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:14.598039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:14.690605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:14.691208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:14.691480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:14.691746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:14.693383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:14.798896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:14.800539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f932b5-4785-4889-b427-13b0a99b457f service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:14.819925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 724/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:16.714657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa30b5-e694-4559-83f8-67a30fabc119 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:16.715205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa30b5-e694-4559-83f8-67a30fabc119 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:16.715319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa30b5-e694-4559-83f8-67a30fabc119 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:16.716989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:16.722736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f92b7-cf62-4ec4-a214-698635bd3e15 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:16.723237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f92b7-cf62-4ec4-a214-698635bd3e15 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:16.723237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f92b7-cf62-4ec4-a214-698635bd3e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:16.770078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:16.796664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e77f92b7-cf62-4ec4-a214-698635bd3e15 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:16.797893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e77f92b7-cf62-4ec4-a214-698635bd3e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:16.899576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:16.939675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa30b5-e694-4559-83f8-67a30fabc119 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:16.941265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c9fa30b5-e694-4559-83f8-67a30fabc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:17.055799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa30b5-e694-4559-83f8-67a30fabc119 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:17.088605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:17.130821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:17.131413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:17.131680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:17.131942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:17.133537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:17.247513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:17.248974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e8e71-f956-43c1-8646-7c9ab9899ebd service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:17.267655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 718/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:19.402389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676240-76c7-4207-a8e1-bc5063dd4364 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:19.403015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676240-76c7-4207-a8e1-bc5063dd4364 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:19.403015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02676240-76c7-4207-a8e1-bc5063dd4364 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:19.404267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:19.410777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce38e-c1f2-4d47-b51f-6cf42d6a467d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:19.411558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce38e-c1f2-4d47-b51f-6cf42d6a467d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:19.411688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ce38e-c1f2-4d47-b51f-6cf42d6a467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:19.492714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-852ce38e-c1f2-4d47-b51f-6cf42d6a467d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:19.493919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-852ce38e-c1f2-4d47-b51f-6cf42d6a467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:19.506971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:19.599345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:19.639221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676240-76c7-4207-a8e1-bc5063dd4364 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:19.641212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-02676240-76c7-4207-a8e1-bc5063dd4364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:19.747665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02676240-76c7-4207-a8e1-bc5063dd4364 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:19.760118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:19.822995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:19.823600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:19.823874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:19.824142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:19.825786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:19.960029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:19.962426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9dd5fc-61b1-4906-bd9c-a23e293ed101 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:19.985143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 727/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:22.391517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311305-2d22-4551-85cc-3e2cabb92f76 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:22.392251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311305-2d22-4551-85cc-3e2cabb92f76 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:22.392430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52311305-2d22-4551-85cc-3e2cabb92f76 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:22.394546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:22.403029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0d29e-bbb9-4139-ac85-92e9aaaa0bf8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:22.403717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0d29e-bbb9-4139-ac85-92e9aaaa0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:22.403883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0d29e-bbb9-4139-ac85-92e9aaaa0bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:22.464609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:22.489860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-eea0d29e-bbb9-4139-ac85-92e9aaaa0bf8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:22.491106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-eea0d29e-bbb9-4139-ac85-92e9aaaa0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:22.592995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:22.635193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311305-2d22-4551-85cc-3e2cabb92f76 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:22.637453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-52311305-2d22-4551-85cc-3e2cabb92f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:22.747016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52311305-2d22-4551-85cc-3e2cabb92f76 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:22.788929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:22.825012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:22.825614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:22.825885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:22.826147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:22.827827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:22.947892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:22.949371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4a150-d22f-4a00-a5ac-3a0b5cc93424 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:22.968363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 721/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:25.168153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bab40-89b5-437e-bf35-436733d4ac61 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:25.169079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bab40-89b5-437e-bf35-436733d4ac61 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:25.169079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bab40-89b5-437e-bf35-436733d4ac61 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:25.171276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:25.180338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c04e9-a4e7-496b-9065-65c50f82bcf4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:25.181072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c04e9-a4e7-496b-9065-65c50f82bcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:25.181258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c04e9-a4e7-496b-9065-65c50f82bcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:25.254227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-de4c04e9-a4e7-496b-9065-65c50f82bcf4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:25.255436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-de4c04e9-a4e7-496b-9065-65c50f82bcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:25.278590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:25.357439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:25.398171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bab40-89b5-437e-bf35-436733d4ac61 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:25.400263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-056bab40-89b5-437e-bf35-436733d4ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:25.515964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bab40-89b5-437e-bf35-436733d4ac61 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:25.538579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:25.596493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:25.597089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:25.597364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:25.597631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:25.599215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:25.711713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:25.713179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462cddf-6595-40ff-afd8-1f00c0aadeec service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:25.731346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 730/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:27.894135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482aac0-5cb8-4d5b-afac-1e8e56c76989 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:27.894613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482aac0-5cb8-4d5b-afac-1e8e56c76989 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:27.894613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482aac0-5cb8-4d5b-afac-1e8e56c76989 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:27.896009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:27.901440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc256-a83a-4379-a4a3-90deab43b606 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:27.901890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc256-a83a-4379-a4a3-90deab43b606 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:27.902004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebc256-a83a-4379-a4a3-90deab43b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:27.984325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:27.987287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bcebc256-a83a-4379-a4a3-90deab43b606 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:27.989236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcebc256-a83a-4379-a4a3-90deab43b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:28.093124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:28.134216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482aac0-5cb8-4d5b-afac-1e8e56c76989 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:28.136137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b482aac0-5cb8-4d5b-afac-1e8e56c76989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:28.250398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482aac0-5cb8-4d5b-afac-1e8e56c76989 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:28.306935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:28.331887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:28.332524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:28.332799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:28.333068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:28.334643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:28.455291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:28.456742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b012f9-37ef-4359-99f6-807e09c8b77d service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:28.475469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 724/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:30.526318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc395-cc8c-4739-a059-e23b67ceedd8 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:30.526918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc395-cc8c-4739-a059-e23b67ceedd8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:30.526918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8dc395-cc8c-4739-a059-e23b67ceedd8 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:30.528287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:30.533845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced6fa-57f3-4127-bea6-34bb4685d10b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:30.534268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced6fa-57f3-4127-bea6-34bb4685d10b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:30.534380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced6fa-57f3-4127-bea6-34bb4685d10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:30.608910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0bced6fa-57f3-4127-bea6-34bb4685d10b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:30.610107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0bced6fa-57f3-4127-bea6-34bb4685d10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:30.647427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:30.719966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:30.759395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc395-cc8c-4739-a059-e23b67ceedd8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:30.762584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6d8dc395-cc8c-4739-a059-e23b67ceedd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:30.872121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8dc395-cc8c-4739-a059-e23b67ceedd8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:30.905214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:30.953197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:30.953812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:30.954087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:30.954356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:30.955957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:31.071662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:31.073133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1eeba-5e62-47a3-b30f-98aa7d5f62da service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:31.093253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 733/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:33.153952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474c20-9c51-4982-ac71-c955d6739851 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:33.154491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474c20-9c51-4982-ac71-c955d6739851 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:33.154491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00474c20-9c51-4982-ac71-c955d6739851 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:33.155830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:33.161547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75fa9-fee6-4a19-9cb4-c72c083c3088 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:33.161993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75fa9-fee6-4a19-9cb4-c72c083c3088 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:33.162089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b75fa9-fee6-4a19-9cb4-c72c083c3088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:33.245468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c8b75fa9-fee6-4a19-9cb4-c72c083c3088 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:33.246681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c8b75fa9-fee6-4a19-9cb4-c72c083c3088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:33.255497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:33.488356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:33.526341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474c20-9c51-4982-ac71-c955d6739851 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:33.527897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-00474c20-9c51-4982-ac71-c955d6739851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:33.637078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00474c20-9c51-4982-ac71-c955d6739851 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:33.692781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:33.712865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:33.713465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:33.713729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:33.713985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:33.715553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:33.831493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:33.832947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16297bf-642b-4df4-9368-224ef23f1605 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:33.859785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 727/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:35.902764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d0b3-b152-4de2-8bb7-887b6ecd2e52 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.903313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d0b3-b152-4de2-8bb7-887b6ecd2e52 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.903313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3d0b3-b152-4de2-8bb7-887b6ecd2e52 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.904666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:35.910892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1d70-e9e2-4d78-9a43-f056e68c1e18 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:35.911337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1d70-e9e2-4d78-9a43-f056e68c1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:35.911434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1d70-e9e2-4d78-9a43-f056e68c1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:35.978811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d01a1d70-e9e2-4d78-9a43-f056e68c1e18 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:35.980016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d01a1d70-e9e2-4d78-9a43-f056e68c1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:36.018848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:36.084169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:36.124850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d0b3-b152-4de2-8bb7-887b6ecd2e52 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:36.126419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-aec3d0b3-b152-4de2-8bb7-887b6ecd2e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:36.263943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3d0b3-b152-4de2-8bb7-887b6ecd2e52 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:36.305044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:36.343497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:36.344101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:36.344404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:36.344674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:36.346254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:36.461019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:36.462452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838e917-118f-4928-baf2-eb55c9923193 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:36.480595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 736/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:38.509994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb036-8291-4401-8c8a-dc77692d2717 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:38.510895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb036-8291-4401-8c8a-dc77692d2717 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:38.510895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cb036-8291-4401-8c8a-dc77692d2717 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:38.512218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:38.518155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf81fad-9c69-4b0b-8af0-71a7d19ce84c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:38.518622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf81fad-9c69-4b0b-8af0-71a7d19ce84c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:38.518736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf81fad-9c69-4b0b-8af0-71a7d19ce84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:38.584930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2cf81fad-9c69-4b0b-8af0-71a7d19ce84c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:38.586168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2cf81fad-9c69-4b0b-8af0-71a7d19ce84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:38.604610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:38.694158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:38.733608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb036-8291-4401-8c8a-dc77692d2717 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:38.735125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-521cb036-8291-4401-8c8a-dc77692d2717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:38.840732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cb036-8291-4401-8c8a-dc77692d2717 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:38.919506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:38.927212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:38.927815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:38.928083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:38.928353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:38.929949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:39.041092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:39.042519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d9ade-21fb-4ccb-92a3-74fb71049cb3 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:39.061618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 730/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:41.108743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b287-292b-42de-999a-9c7ef956e952 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:41.109571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b287-292b-42de-999a-9c7ef956e952 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:41.109571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444b287-292b-42de-999a-9c7ef956e952 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:41.111777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:16:41.118388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd54a3-0365-4ac7-8e57-c6a06bdc09f4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:41.118806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd54a3-0365-4ac7-8e57-c6a06bdc09f4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:41.118942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd54a3-0365-4ac7-8e57-c6a06bdc09f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:41.196437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-74cd54a3-0365-4ac7-8e57-c6a06bdc09f4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:16:41.197571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-74cd54a3-0365-4ac7-8e57-c6a06bdc09f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:41.247550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:41.300673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:16:41.350609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b287-292b-42de-999a-9c7ef956e952 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:16:41.352926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c444b287-292b-42de-999a-9c7ef956e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:41.469294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444b287-292b-42de-999a-9c7ef956e952 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:16:41.520985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:41.547489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:16:41.548083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:16:41.548353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:16:41.548644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:16:41.550220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:16:41.662656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:16:41.664105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8cb82-ba8a-437a-aac0-245cf1f74a8d service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:16:41.681986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 739/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:16:51.298675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=22 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:16:51.679755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=66 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:01.152226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6391118-c794-4c19-90eb-54f63e711523 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:01.152814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6391118-c794-4c19-90eb-54f63e711523 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:01.152814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6391118-c794-4c19-90eb-54f63e711523 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:01.154043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 732/1471] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:01.160531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c02c4-d37c-481e-8cad-bcde61407099 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:01.161133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c02c4-d37c-481e-8cad-bcde61407099 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:01.161232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c02c4-d37c-481e-8cad-bcde61407099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:01.240606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e10c02c4-d37c-481e-8cad-bcde61407099 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:01.242580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e10c02c4-d37c-481e-8cad-bcde61407099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:01.350933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 740/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:01.439511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d975e-23de-41eb-a33d-9c07bfe2151d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:01.439790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d975e-23de-41eb-a33d-9c07bfe2151d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:01.440052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d975e-23de-41eb-a33d-9c07bfe2151d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:01.441438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 733/1473] 10.222.0.60 () {54 vars in 967 bytes} [Tue Aug 9 12:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:01.447268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af53546-b037-4211-b0f6-38a674f7d53e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:01.447574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af53546-b037-4211-b0f6-38a674f7d53e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:01.447840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af53546-b037-4211-b0f6-38a674f7d53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:01.530177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0af53546-b037-4211-b0f6-38a674f7d53e None None] MFA Rules not processed for user `cf3acf73742b49409bfc4128386a3302`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:01.531381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0af53546-b037-4211-b0f6-38a674f7d53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:01.552837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:01.616829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 741/1474] 10.222.0.60 () {58 vars in 1064 bytes} [Tue Aug 9 12:17:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:17:01.625289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d975e-23de-41eb-a33d-9c07bfe2151d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:01.627757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-097d975e-23de-41eb-a33d-9c07bfe2151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:01.745935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d975e-23de-41eb-a33d-9c07bfe2151d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:01.823587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:01.824190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:01.824476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:01.824737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:01.826357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:01.888670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:01.947595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:01.949064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5225f3-4089-4a2e-9637-7031a4285001 service glance] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:01.966679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 734/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:04.102441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbd99-8ac4-4f3b-86dd-4ad7efbf20c3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:04.103346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbd99-8ac4-4f3b-86dd-4ad7efbf20c3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:04.103346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cbd99-8ac4-4f3b-86dd-4ad7efbf20c3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:04.105553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 742/1476] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:04.112244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37faed-c9f9-465b-8bed-8c61b3cdd4b2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:04.113053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37faed-c9f9-465b-8bed-8c61b3cdd4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:04.113283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37faed-c9f9-465b-8bed-8c61b3cdd4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:04.187876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-be37faed-c9f9-465b-8bed-8c61b3cdd4b2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:04.189030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-be37faed-c9f9-465b-8bed-8c61b3cdd4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:04.296322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 735/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:04.320544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbd99-8ac4-4f3b-86dd-4ad7efbf20c3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:04.322869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-002cbd99-8ac4-4f3b-86dd-4ad7efbf20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:04.463653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cbd99-8ac4-4f3b-86dd-4ad7efbf20c3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:04.520414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:04.574772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:04.575378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:04.575652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:04.575926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:04.576603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:04.578475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:17:04.578475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:17:04.578475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:17:04.579618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809fc06-5c53-4bfe-a98f-f50ac8779076 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:04.598532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 743/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Tue Aug 9 12:17:04 2022] GET /identity/v3/projects => generated 2553 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:17:06.621780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ca3c-c03b-4fe6-b021-5ee3347e419a None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:06.622692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ca3c-c03b-4fe6-b021-5ee3347e419a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:06.622692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ca3c-c03b-4fe6-b021-5ee3347e419a None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:06.624542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 736/1479] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:06.629957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0b4f7-6174-491b-89d4-6b5b072571f6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:06.630382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0b4f7-6174-491b-89d4-6b5b072571f6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:06.630510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0b4f7-6174-491b-89d4-6b5b072571f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:06.701024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e5e0b4f7-6174-491b-89d4-6b5b072571f6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:06.702290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e5e0b4f7-6174-491b-89d4-6b5b072571f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:06.810188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 744/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:06.859509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ca3c-c03b-4fe6-b021-5ee3347e419a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:06.861240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1650ca3c-c03b-4fe6-b021-5ee3347e419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:06.871332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:07.015498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ca3c-c03b-4fe6-b021-5ee3347e419a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:07.098954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:07.134322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:07.135281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:07.135553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:07.135805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:07.137451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:07.234428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:07.236010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee4317-0bce-4997-8b15-26d7ad8baef8 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:07.254220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 737/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:09.448801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dd970-4ef7-4527-af5f-245a5fcf0d6c None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:09.449429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dd970-4ef7-4527-af5f-245a5fcf0d6c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:09.449429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9dd970-4ef7-4527-af5f-245a5fcf0d6c None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:09.450685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 745/1482] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:09.456903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d240-75e5-4e87-8d46-2a93f882dea3 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:09.457363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d240-75e5-4e87-8d46-2a93f882dea3 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:09.457462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4d240-75e5-4e87-8d46-2a93f882dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:09.527410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-38b4d240-75e5-4e87-8d46-2a93f882dea3 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:09.528689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-38b4d240-75e5-4e87-8d46-2a93f882dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:09.575320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:09.629319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 738/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:09.668621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dd970-4ef7-4527-af5f-245a5fcf0d6c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:09.670271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-af9dd970-4ef7-4527-af5f-245a5fcf0d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:09.693852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:09.777749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9dd970-4ef7-4527-af5f-245a5fcf0d6c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:09.861385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:09.861989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:09.862255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:09.862522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:09.864093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:09.943201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:09.980010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:09.981490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de134986-5e5a-42e0-acf0-e45777e85c7a service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:09.999727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 746/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:12.057952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f90d-c186-42f8-8348-1563dd785d0c None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:12.058653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f90d-c186-42f8-8348-1563dd785d0c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:12.058653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8f90d-c186-42f8-8348-1563dd785d0c None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:12.059827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 739/1485] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:12.065318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b526d-b833-47ae-b067-5f5857c053c7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:12.065814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b526d-b833-47ae-b067-5f5857c053c7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:12.065814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b526d-b833-47ae-b067-5f5857c053c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:12.131692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b70b526d-b833-47ae-b067-5f5857c053c7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:12.132927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b70b526d-b833-47ae-b067-5f5857c053c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:12.245012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 747/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:12.286026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f90d-c186-42f8-8348-1563dd785d0c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:12.288364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-93b8f90d-c186-42f8-8348-1563dd785d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:12.400197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8f90d-c186-42f8-8348-1563dd785d0c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:12.475622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:12.477735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:12.478407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:12.478711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:12.478959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:12.481208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:12.605611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:12.606977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf479de6-1420-4dba-8239-f18748a0eefe service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:12.627246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 740/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:14.776855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6fab-5b30-4ad9-91ae-2a3a5577ba40 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:14.777454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6fab-5b30-4ad9-91ae-2a3a5577ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:14.777454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6fab-5b30-4ad9-91ae-2a3a5577ba40 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:14.778738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 748/1488] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:14.787547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170fbc1-36a2-40c9-92cc-fea809f631aa None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:14.787980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170fbc1-36a2-40c9-92cc-fea809f631aa None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:14.788084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170fbc1-36a2-40c9-92cc-fea809f631aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:14.867470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c170fbc1-36a2-40c9-92cc-fea809f631aa None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:14.868692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c170fbc1-36a2-40c9-92cc-fea809f631aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:14.930040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:14.976631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 741/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:15.020768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6fab-5b30-4ad9-91ae-2a3a5577ba40 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:15.022338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-42ea6fab-5b30-4ad9-91ae-2a3a5577ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:15.059039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:15.126109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6fab-5b30-4ad9-91ae-2a3a5577ba40 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:15.209106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:15.209688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:15.209961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:15.210225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:15.211832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:15.297086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:15.326675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:15.328227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d150951-3078-4da5-acae-5fa2e922a8d2 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:15.346834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 749/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:17.517289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0184-0e05-4115-b57a-03f9e90769ca None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:17.518225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0184-0e05-4115-b57a-03f9e90769ca None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:17.518225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0184-0e05-4115-b57a-03f9e90769ca None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:17.520292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 742/1491] 10.222.0.60 () {54 vars in 927 bytes} [Tue Aug 9 12:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:17:17.526678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd508-4f85-4936-9c1a-791794eb8d1b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:17.527425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd508-4f85-4936-9c1a-791794eb8d1b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:17.527586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bd508-4f85-4936-9c1a-791794eb8d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:17.596842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bb4bd508-4f85-4936-9c1a-791794eb8d1b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:17:17.598071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb4bd508-4f85-4936-9c1a-791794eb8d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:17.703171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 750/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Tue Aug 9 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:17:17.742376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0184-0e05-4115-b57a-03f9e90769ca None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:17:17.743927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e93a0184-0e05-4115-b57a-03f9e90769ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:17.862580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0184-0e05-4115-b57a-03f9e90769ca None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:17:17.954341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:17:17.954955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:17:17.955225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:17:17.955484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:17:17.957114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:17:17.966543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:18.074613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:17:18.076053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987e771-6cbb-4640-8524-589745590ccc service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:17:18.096286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 743/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:17:27.700560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=82 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:17:28.092866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=50 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:29.004196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:29.004861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:29.004861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:29.085078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:29.086290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:29.184758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 751/1494] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:29.193255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:29.193782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:29.193782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:29.275937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:29.277195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:29.404213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 744/1495] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:29.409361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:29.410625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:29.422560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74a7c7-3a0d-4dc3-9c1f-d1767336716e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:29.488233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:29.522893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:29.523500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:29.523772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:29.524032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:29.524700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:18:29.524996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:29.526013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:29.526013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:18:29.526013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:18:29.526891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:29.539426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 752/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:18:29.548369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:29.558035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afafd5b-cc59-4ede-bbb3-26d03493058c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:29.626034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:29.671124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:29.671732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:29.671999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:29.672266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:29.672920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:29.674650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:29.674650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:18:29.674650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:18:29.675833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:29.735370 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 745/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:18:29 2022] POST /identity/v3/projects => generated 379 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:18:29.739973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:29.741517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:29.786040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fc769-3dbf-43a7-802d-772c3c8d419e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:29.885871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:29.886453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:29.886878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:29.887144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:29.887755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:29.888798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:29.888798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:18:29.888798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:18:29.890132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:29.935872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 753/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:18:29 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:18:29.940257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:29.941803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:30.005691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862202-da7b-44ed-954d-50eabcbf159e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:30.091037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:30.102743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:30.103344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:30.103615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:30.103871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:30.104514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:30.105527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:30.105527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:18:30.105527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:18:30.106392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:30.118698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 746/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:18:30.123189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:30.124789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:30.136999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916458a0-9fd8-4e48-af84-f585cdd17eec admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:30.174092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:30.254350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:30.254955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:30.255226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:30.255491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:30.256185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:30.257175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:30.257175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:18:30.257175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:18:30.258141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa1d06-8a00-4aa4-837d-7ca1175f67b2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:30.270810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 754/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:18:30.275585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:30.277169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:30.313352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f4cd4-bf45-413d-9b23-e3cee76a4842 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:30.415168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:30.415835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:30.416105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:30.416365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] PATH_INFO: `/v3/projects/324112bedd8a4dd19c2bcebbb56fff5c/users/39d745db3a6e486fb7bbcba13e392b18/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:30.446877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324112bedd8a4dd19c2bcebbb56fff5c, user_id=39d745db3a6e486fb7bbcba13e392b18, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:30.447946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:30.447946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:18:30.447946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:18:30.449857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa999b6c-938e-4d44-922a-0eb4738d73d3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:30.479249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 747/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:18:30 2022] PUT /identity/v3/projects/324112bedd8a4dd19c2bcebbb56fff5c/users/39d745db3a6e486fb7bbcba13e392b18/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:18:30.492338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf751b0-f5cb-4219-9688-e0e091b34cb6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:30.492665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf751b0-f5cb-4219-9688-e0e091b34cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:30.492936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf751b0-f5cb-4219-9688-e0e091b34cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:30.553697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ccf751b0-f5cb-4219-9688-e0e091b34cb6 None None] MFA Rules not processed for user `39d745db3a6e486fb7bbcba13e392b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:30.554849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ccf751b0-f5cb-4219-9688-e0e091b34cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:30.637975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 755/1502] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:30.651872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e974a-22ed-4302-b95f-cb4739db4263 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:30.652159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e974a-22ed-4302-b95f-cb4739db4263 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:30.652476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e974a-22ed-4302-b95f-cb4739db4263 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:30.653905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 748/1503] 10.222.0.60 () {54 vars in 964 bytes} [Tue Aug 9 12:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:18:30.658937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890738bb-9bab-4d5b-ba4f-584e3cfb5a5d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:30.659225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890738bb-9bab-4d5b-ba4f-584e3cfb5a5d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:30.659516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890738bb-9bab-4d5b-ba4f-584e3cfb5a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:30.691280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:30.734794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-890738bb-9bab-4d5b-ba4f-584e3cfb5a5d None None] MFA Rules not processed for user `f1157b842770470fb1bc61297ae0e2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:30.736008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-890738bb-9bab-4d5b-ba4f-584e3cfb5a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:30.817264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 756/1504] 10.222.0.60 () {58 vars in 1061 bytes} [Tue Aug 9 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:30.825428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e974a-22ed-4302-b95f-cb4739db4263 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:30.827033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b03e974a-22ed-4302-b95f-cb4739db4263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:30.887212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:30.945389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e974a-22ed-4302-b95f-cb4739db4263 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:31.028556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:31.029158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:31.029434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:31.029689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:31.031307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:31.134458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:31.135805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:31.139210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:31.154936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 749/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:18:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:18:31.201227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331ee49-b058-4453-885b-774739a79004 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:31.201664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331ee49-b058-4453-885b-774739a79004 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:31.201770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331ee49-b058-4453-885b-774739a79004 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:31.203019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 757/1506] 10.222.0.60 () {52 vars in 830 bytes} [Tue Aug 9 12:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:18:31.207198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:31.209260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:31.329227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6130775-3b6b-456a-9317-e811c45795dc service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:31.427433 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:31.427979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:31.428250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:31.428548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] PATH_INFO: `/v3/users/39d745db3a6e486fb7bbcba13e392b18` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:31.441011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d745db3a6e486fb7bbcba13e392b18)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:31.442036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:31.442036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:18:31.442036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:18:31.443242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:31.454233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:31.517452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d745db3a6e486fb7bbcba13e392b18'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:31.529438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d745db3a6e486fb7bbcba13e392b18'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:31.529862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d745db3a6e486fb7bbcba13e392b18'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:31.553907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d745db3a6e486fb7bbcba13e392b18'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:31.554457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d745db3a6e486fb7bbcba13e392b18'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:31.573862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 750/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:18:31 2022] DELETE /identity/v3/users/39d745db3a6e486fb7bbcba13e392b18 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:18:31.578764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:31.579045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:31.579313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:31.651486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:18:31.652838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:31.731162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:31.744984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 758/1508] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:18:31.759468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:31.761050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:31.870263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373573dc-93ff-4079-a0d3-d3402370c973 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:31.934323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:31.955759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:31.956372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:31.956673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:31.956934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:31.958523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:32.072189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:32.073654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bd54f-0c87-4fe0-937e-77e4b9700e7f service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:32.094117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 751/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:18:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:18:32.446888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:18:32.448227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:18:32.460744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970783b-3f1e-4acb-b133-bcd364ebb60f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:18:32.558204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:18:32.558839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:18:32.559115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:18:32.559387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] PATH_INFO: `/v3/projects/324112bedd8a4dd19c2bcebbb56fff5c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:18:32.569861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324112bedd8a4dd19c2bcebbb56fff5c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:18:32.570897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:18:32.570897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:18:32.570897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:18:32.572131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:18:32.635532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324112bedd8a4dd19c2bcebbb56fff5c', 'request_id': 'req-0f5420f4-f97d-4965-b8c7-417ccd6b0787'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:32.642325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324112bedd8a4dd19c2bcebbb56fff5c', 'request_id': 'req-0f5420f4-f97d-4965-b8c7-417ccd6b0787'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:32.655953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324112bedd8a4dd19c2bcebbb56fff5c', 'request_id': 'req-0f5420f4-f97d-4965-b8c7-417ccd6b0787'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:32.684788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] The token cache is being invalidate because project 324112bedd8a4dd19c2bcebbb56fff5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:18:32.685042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:32.685488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0f5420f4-f97d-4965-b8c7-417ccd6b0787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:18:32.687048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 759/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:18:32 2022] DELETE /identity/v3/projects/324112bedd8a4dd19c2bcebbb56fff5c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:18:42.091067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=62 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:18:42.682349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:19:59.257213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e777c-6d77-427d-8c54-a8ec275c38b8 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:59.258072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e777c-6d77-427d-8c54-a8ec275c38b8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:59.258072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e777c-6d77-427d-8c54-a8ec275c38b8 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:59.260090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:19:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:19:59.267355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76e06-b4d0-4f0a-84cb-22a154bf0d82 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:59.267820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76e06-b4d0-4f0a-84cb-22a154bf0d82 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:59.267923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76e06-b4d0-4f0a-84cb-22a154bf0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:59.353230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f6f76e06-b4d0-4f0a-84cb-22a154bf0d82 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:19:59.354463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f6f76e06-b4d0-4f0a-84cb-22a154bf0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:59.465975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:19:59.625437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e777c-6d77-427d-8c54-a8ec275c38b8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:19:59.628043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bd1e777c-6d77-427d-8c54-a8ec275c38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:19:59.760807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e777c-6d77-427d-8c54-a8ec275c38b8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:19:59.767518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be31e7-fa5c-434b-b52b-b1f7fa3a828f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:19:59.768128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be31e7-fa5c-434b-b52b-b1f7fa3a828f service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:19:59.768405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be31e7-fa5c-434b-b52b-b1f7fa3a828f service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:19:59.768689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be31e7-fa5c-434b-b52b-b1f7fa3a828f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:19:59.776935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be31e7-fa5c-434b-b52b-b1f7fa3a828f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:19:59.778544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be31e7-fa5c-434b-b52b-b1f7fa3a828f service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:19:59.788610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 753/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:00.623399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592739-d830-4b05-83d4-9f0f79646a23 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:00.623997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592739-d830-4b05-83d4-9f0f79646a23 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:00.623997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87592739-d830-4b05-83d4-9f0f79646a23 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:00.625327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:00.630661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6a43-7ad4-415a-bbea-0031ac670a36 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:00.631116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6a43-7ad4-415a-bbea-0031ac670a36 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:00.631217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6a43-7ad4-415a-bbea-0031ac670a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:00.652054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2efb6a43-7ad4-415a-bbea-0031ac670a36 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:00.653265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2efb6a43-7ad4-415a-bbea-0031ac670a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:00.661432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:00.812290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592739-d830-4b05-83d4-9f0f79646a23 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:00.835146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87592739-d830-4b05-83d4-9f0f79646a23 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:00.843328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986f42d-96cc-4c7e-826e-992b3fe6bc91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:00.843931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986f42d-96cc-4c7e-826e-992b3fe6bc91 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:00.844205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986f42d-96cc-4c7e-826e-992b3fe6bc91 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:00.844510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986f42d-96cc-4c7e-826e-992b3fe6bc91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:00.854585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986f42d-96cc-4c7e-826e-992b3fe6bc91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:00.855585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986f42d-96cc-4c7e-826e-992b3fe6bc91 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:00.866550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 762/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:01.381599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f86ef-3d81-4d3f-98ac-55b53b2533fc None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:01.382221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f86ef-3d81-4d3f-98ac-55b53b2533fc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:01.382480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f86ef-3d81-4d3f-98ac-55b53b2533fc None None] PATH_INFO: `/v3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:01.383771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 755/1517] 10.222.0.73 () {54 vars in 925 bytes} [Tue Aug 9 12:20:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:20:01.391615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d595f-55d6-47a0-adef-cd98e6a8babc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:01.391899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d595f-55d6-47a0-adef-cd98e6a8babc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:01.392170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d595f-55d6-47a0-adef-cd98e6a8babc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:01.456158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-191d595f-55d6-47a0-adef-cd98e6a8babc None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:01.457422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-191d595f-55d6-47a0-adef-cd98e6a8babc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:01.474593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:01.531444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 763/1518] 10.222.0.73 () {58 vars in 1015 bytes} [Tue Aug 9 12:20:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:10.647222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=56 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:10.864506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd75b96-4414-42ae-b6e5-a3a8c03806b2 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:10.864780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd75b96-4414-42ae-b6e5-a3a8c03806b2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:10.864926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd75b96-4414-42ae-b6e5-a3a8c03806b2 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:10.866286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 756/1519] 10.222.0.60 () {54 vars in 961 bytes} [Tue Aug 9 12:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:10.871578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d4ff4-082d-4ff8-bd5e-cd3886167550 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:10.872091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d4ff4-082d-4ff8-bd5e-cd3886167550 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:10.872091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d4ff4-082d-4ff8-bd5e-cd3886167550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:10.900334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d17d4ff4-082d-4ff8-bd5e-cd3886167550 None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:10.901600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d17d4ff4-082d-4ff8-bd5e-cd3886167550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:10.912808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 764/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Tue Aug 9 12:20:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:20:10.920460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd75b96-4414-42ae-b6e5-a3a8c03806b2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:10.935636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd75b96-4414-42ae-b6e5-a3a8c03806b2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:10.940805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfb4e2-bb7b-4aea-897d-4b7868080bec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:10.941431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb4e2-bb7b-4aea-897d-4b7868080bec service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:10.941708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb4e2-bb7b-4aea-897d-4b7868080bec service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:10.941970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfb4e2-bb7b-4aea-897d-4b7868080bec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:10.951749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfb4e2-bb7b-4aea-897d-4b7868080bec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:10.953372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfb4e2-bb7b-4aea-897d-4b7868080bec service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:10.963652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 757/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:12.084147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6e48a-f7dd-43dd-8251-887a99b381f5 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:12.084749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6e48a-f7dd-43dd-8251-887a99b381f5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:12.084749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6e48a-f7dd-43dd-8251-887a99b381f5 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:12.086141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:20:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:12.091369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452fc5f-21be-400c-8f90-f304e13d492d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:12.091852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452fc5f-21be-400c-8f90-f304e13d492d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:12.091852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452fc5f-21be-400c-8f90-f304e13d492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:12.119615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e452fc5f-21be-400c-8f90-f304e13d492d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:12.120935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e452fc5f-21be-400c-8f90-f304e13d492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:12.130793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:20:12.294416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6e48a-f7dd-43dd-8251-887a99b381f5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:12.312548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6e48a-f7dd-43dd-8251-887a99b381f5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:12.318472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e4508-0307-4ae3-8b30-3dde9e3624a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:12.319061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4508-0307-4ae3-8b30-3dde9e3624a4 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:12.319330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4508-0307-4ae3-8b30-3dde9e3624a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:12.319595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e4508-0307-4ae3-8b30-3dde9e3624a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:12.327761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e4508-0307-4ae3-8b30-3dde9e3624a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:12.329375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e4508-0307-4ae3-8b30-3dde9e3624a4 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:12.341928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 766/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:13.154519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809b43-3a64-4acd-8879-3aef40288232 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:13.155376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809b43-3a64-4acd-8879-3aef40288232 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:13.155376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809b43-3a64-4acd-8879-3aef40288232 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:13.157534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 12:20:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:13.164748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c566b-3621-48e7-8b6c-2e2f99b2ff3f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:13.165178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c566b-3621-48e7-8b6c-2e2f99b2ff3f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:13.165276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c566b-3621-48e7-8b6c-2e2f99b2ff3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:13.185937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5a3c566b-3621-48e7-8b6c-2e2f99b2ff3f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:13.187140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5a3c566b-3621-48e7-8b6c-2e2f99b2ff3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:13.196368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:13.355383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809b43-3a64-4acd-8879-3aef40288232 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:13.381396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809b43-3a64-4acd-8879-3aef40288232 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:13.388171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf980a-8a67-49c0-bcc9-9a2bf9e0a3f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:13.388807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf980a-8a67-49c0-bcc9-9a2bf9e0a3f1 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:13.389082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf980a-8a67-49c0-bcc9-9a2bf9e0a3f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:13.389348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf980a-8a67-49c0-bcc9-9a2bf9e0a3f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:13.397936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf980a-8a67-49c0-bcc9-9a2bf9e0a3f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:13.399516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf980a-8a67-49c0-bcc9-9a2bf9e0a3f1 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:13.409151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 760/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:17.210842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48a46f-e4ba-4fb5-a66b-64a816a79880 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:17.211442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48a46f-e4ba-4fb5-a66b-64a816a79880 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:17.211442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48a46f-e4ba-4fb5-a66b-64a816a79880 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:17.212776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:17.219053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f105-3916-4bc9-93d4-68e0f010985a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:17.219808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f105-3916-4bc9-93d4-68e0f010985a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:17.219977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00f105-3916-4bc9-93d4-68e0f010985a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:17.243507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-da00f105-3916-4bc9-93d4-68e0f010985a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:17.244760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-da00f105-3916-4bc9-93d4-68e0f010985a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:17.253652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:17.332581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48a46f-e4ba-4fb5-a66b-64a816a79880 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:17.335847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5f48a46f-e4ba-4fb5-a66b-64a816a79880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:17.430319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f48a46f-e4ba-4fb5-a66b-64a816a79880 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:17.434790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd8d5c-67af-40cd-af76-f654daaa3664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:17.435395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8d5c-67af-40cd-af76-f654daaa3664 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:17.435671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8d5c-67af-40cd-af76-f654daaa3664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:17.435939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd8d5c-67af-40cd-af76-f654daaa3664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:17.445871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd8d5c-67af-40cd-af76-f654daaa3664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:17.448123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd8d5c-67af-40cd-af76-f654daaa3664 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:17.461531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 769/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:19.436820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef809-1d9d-4ed9-b507-b61961ff2e83 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:19.437398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef809-1d9d-4ed9-b507-b61961ff2e83 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:19.437398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef809-1d9d-4ed9-b507-b61961ff2e83 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:19.438717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:19.445186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49baa-1cb4-4ddc-b17a-c26e7b3a50cc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:19.445661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49baa-1cb4-4ddc-b17a-c26e7b3a50cc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:19.445766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d49baa-1cb4-4ddc-b17a-c26e7b3a50cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:19.477141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-31d49baa-1cb4-4ddc-b17a-c26e7b3a50cc None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:19.478387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-31d49baa-1cb4-4ddc-b17a-c26e7b3a50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:19.486860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:19.524422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ef809-1d9d-4ed9-b507-b61961ff2e83 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:19.544226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ef809-1d9d-4ed9-b507-b61961ff2e83 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:19.550420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36d663-d917-4aae-b422-b13a7a906ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:19.551024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d663-d917-4aae-b422-b13a7a906ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:19.551418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d663-d917-4aae-b422-b13a7a906ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:19.551687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36d663-d917-4aae-b422-b13a7a906ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:19.562386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d663-d917-4aae-b422-b13a7a906ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:19.563811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36d663-d917-4aae-b422-b13a7a906ed0 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:19.573514 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 763/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:23.096617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dbf8b-e22c-4682-85ba-1fbff80dcf31 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:23.097213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dbf8b-e22c-4682-85ba-1fbff80dcf31 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:23.097213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2dbf8b-e22c-4682-85ba-1fbff80dcf31 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:23.098511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:20:23.105241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755719-43ca-4c92-824f-0dd3053076aa None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:23.105697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755719-43ca-4c92-824f-0dd3053076aa None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:23.105790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755719-43ca-4c92-824f-0dd3053076aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:23.130464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6d755719-43ca-4c92-824f-0dd3053076aa None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:23.132078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6d755719-43ca-4c92-824f-0dd3053076aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:23.140619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:23.445252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dbf8b-e22c-4682-85ba-1fbff80dcf31 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:23.447542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8b2dbf8b-e22c-4682-85ba-1fbff80dcf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:23.514369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:23.529535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2dbf8b-e22c-4682-85ba-1fbff80dcf31 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:23.533970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6e29a-4b45-4d6c-bee0-34e8dfaef183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:23.534586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e29a-4b45-4d6c-bee0-34e8dfaef183 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:23.534864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e29a-4b45-4d6c-bee0-34e8dfaef183 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:23.535134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6e29a-4b45-4d6c-bee0-34e8dfaef183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:23.544685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e29a-4b45-4d6c-bee0-34e8dfaef183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:23.546120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea6e29a-4b45-4d6c-bee0-34e8dfaef183 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:23.557461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 772/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:20:25.568518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ce30-3f15-43dc-a9a1-85ffdc5fb6a3 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:25.569149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ce30-3f15-43dc-a9a1-85ffdc5fb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:25.569149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37ce30-3f15-43dc-a9a1-85ffdc5fb6a3 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:25.570567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 12:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 12:20:25.577124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986924b4-dcb0-47e0-9a76-131d92bc69a9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:25.577621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986924b4-dcb0-47e0-9a76-131d92bc69a9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:25.577732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986924b4-dcb0-47e0-9a76-131d92bc69a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:25.601407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-986924b4-dcb0-47e0-9a76-131d92bc69a9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:20:25.602619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-986924b4-dcb0-47e0-9a76-131d92bc69a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:25.611244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:20:25.917321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ce30-3f15-43dc-a9a1-85ffdc5fb6a3 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:20:25.919390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bd37ce30-3f15-43dc-a9a1-85ffdc5fb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:20:25.933594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37ce30-3f15-43dc-a9a1-85ffdc5fb6a3 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:20:25.937274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfe87e-9f79-4760-b993-8a9a99dffdc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:20:25.937870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfe87e-9f79-4760-b993-8a9a99dffdc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:20:25.938144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfe87e-9f79-4760-b993-8a9a99dffdc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:20:25.938413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfe87e-9f79-4760-b993-8a9a99dffdc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:20:25.948299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfe87e-9f79-4760-b993-8a9a99dffdc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:20:25.949785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfe87e-9f79-4760-b993-8a9a99dffdc3 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:20:25.959565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 766/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:20:35.596317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=11 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:20:35.955420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=33 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:50.370354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454a08e-6428-4df4-b170-8b7dcc7aeda7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.372983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454a08e-6428-4df4-b170-8b7dcc7aeda7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.372983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454a08e-6428-4df4-b170-8b7dcc7aeda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.382049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297cfe9-1a76-4b23-861a-108fcb8815f0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.384880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297cfe9-1a76-4b23-861a-108fcb8815f0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.384880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297cfe9-1a76-4b23-861a-108fcb8815f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.400659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5454a08e-6428-4df4-b170-8b7dcc7aeda7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.402750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5454a08e-6428-4df4-b170-8b7dcc7aeda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.419082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 774/1540] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.419715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9297cfe9-1a76-4b23-861a-108fcb8815f0 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.425431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9297cfe9-1a76-4b23-861a-108fcb8815f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.428623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.428906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.429174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.447295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 767/1541] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 09 12:21:50.456429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.457968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.458241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.461896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.463137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.483819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.485185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.496714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 775/1542] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:50.501649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 768/1543] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:50.501878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.506677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.521427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02928e-8c01-4a32-823e-c3867ca576d9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.523249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c59ca-adb8-42d1-8cb3-3046392e2617 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.534636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.535286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.535561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.535826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.536686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:50.536990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.537277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.537988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.538099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:50.538099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:21:50.538099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:21:50.538324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.538518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.538893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77092c8f-0b77-47d6-843a-591a38cd0771 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.539214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:50.539515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.541277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.560441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 769/1544] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:21:50.562376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.562659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.562929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.574877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 776/1545] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:21:50.575751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.599640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058bfdb-875e-4316-8807-b7f3552a4a2d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.600220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.601564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.620713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 770/1546] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.621561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.632730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.633364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.633643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.633913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.634548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.635571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:50.635571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:21:50.635571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:21:50.635840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75283f-9b63-4dc1-bd38-9f6d0fac08dc None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.636798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced8dc88-b3fc-46cb-87ab-37e9b405d8d6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.652109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27f9ce-b3c9-4dff-89bf-90d26c22bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.652775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27f9ce-b3c9-4dff-89bf-90d26c22bf6e admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.653041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27f9ce-b3c9-4dff-89bf-90d26c22bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.653426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27f9ce-b3c9-4dff-89bf-90d26c22bf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.654061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27f9ce-b3c9-4dff-89bf-90d26c22bf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.656038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27f9ce-b3c9-4dff-89bf-90d26c22bf6e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.730449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 771/1547] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:50.731830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.732261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.732663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.740974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 777/1548] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/projects => generated 405 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:50.742305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f9819-ce84-4d56-90d6-1708760e84a8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.742593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f9819-ce84-4d56-90d6-1708760e84a8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.742862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f9819-ce84-4d56-90d6-1708760e84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.760966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.762226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.771195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8c8f9819-ce84-4d56-90d6-1708760e84a8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.772432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8c8f9819-ce84-4d56-90d6-1708760e84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.830646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 772/1549] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.831490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.845627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1197cba-26c2-4c1e-97ac-f9364b760c6b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.847044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 778/1550] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.848315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.848628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.849032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.855019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.855882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.856155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.856434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.857054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.858131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:50.858131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:21:50.858131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:21:50.859462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369c5c-13ba-4ed4-a8ca-bb0fcd920a3c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.871143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.872544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.885350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 773/1551] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:50.886793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.887135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.887497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.890826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 779/1552] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.891969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.904369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31afe87-5ad1-4c32-a6cc-89fb8aa18bb2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.916328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.916729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad36f1-3d48-4cce-8233-9014c8900ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.917363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad36f1-3d48-4cce-8233-9014c8900ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.917654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad36f1-3d48-4cce-8233-9014c8900ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.917767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.917902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad36f1-3d48-4cce-8233-9014c8900ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.918553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad36f1-3d48-4cce-8233-9014c8900ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.920586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad36f1-3d48-4cce-8233-9014c8900ec3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.926247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 774/1553] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.927017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.938761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b3171-f3ed-4d85-b907-23ffa6ae1bec None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:50.944788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:50.945399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.945671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.946265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.946771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:50.946893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 780/1554] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:50.946980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:50.947902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.948159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.948451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.948809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700180bd-9ec4-4479-a3e8-d9857dfe704a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:50.971338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 775/1555] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:50.971338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5698-783c-458f-99f1-cf91884eee8f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:50.971338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5698-783c-458f-99f1-cf91884eee8f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:50.971338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab5698-783c-458f-99f1-cf91884eee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:50.975817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.977053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.985514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 781/1556] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:50.986396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:50.992964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-63ab5698-783c-458f-99f1-cf91884eee8f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:50.994154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-63ab5698-783c-458f-99f1-cf91884eee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:50.997687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199ceca-2c95-45f4-a5a7-1c3b061a9cb7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.002111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 776/1557] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.002874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583bd57-ae5b-4220-bf66-df3335df321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.003343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0d75d-5baa-4b22-8672-1de183e3ea07 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.003616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0d75d-5baa-4b22-8672-1de183e3ea07 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.003734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583bd57-ae5b-4220-bf66-df3335df321e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.003916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0d75d-5baa-4b22-8672-1de183e3ea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.004037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583bd57-ae5b-4220-bf66-df3335df321e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.004203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583bd57-ae5b-4220-bf66-df3335df321e admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.005230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583bd57-ae5b-4220-bf66-df3335df321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.007256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583bd57-ae5b-4220-bf66-df3335df321e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.017873 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 782/1558] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.019855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.019855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.019855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.026019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-5ce0d75d-5baa-4b22-8672-1de183e3ea07 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.027291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5ce0d75d-5baa-4b22-8672-1de183e3ea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.035160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 777/1559] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.036347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.036641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.036926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.039290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.040509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.048522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 783/1560] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.049295 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.058757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.060028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.060889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78944-26ac-4baa-b6aa-ad5a85dde501 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.065704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544eb2d-d32d-4b9a-b7b3-4b53b48cebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.066293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544eb2d-d32d-4b9a-b7b3-4b53b48cebc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.066572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544eb2d-d32d-4b9a-b7b3-4b53b48cebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.066827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544eb2d-d32d-4b9a-b7b3-4b53b48cebc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.067451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544eb2d-d32d-4b9a-b7b3-4b53b48cebc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.068570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 778/1561] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.069066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544eb2d-d32d-4b9a-b7b3-4b53b48cebc4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.069334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.078715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002371f-a28b-49ce-8f2a-966c709ce7d5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.082714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 784/1562] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.082714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.082714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.082714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.083626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.084218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.084526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.084794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.085407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.087288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.100594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.101789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.110655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 785/1563] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.111448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.119141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 779/1564] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.119961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.121212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ef6f1-4622-4801-a763-c68ebf7b7852 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.139273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.154535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.179128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.179741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.180016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.180285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.180957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:51.181253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.182856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.184417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb688b8-df0b-418b-aa3d-1bd768436f39 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.189303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096609f-6227-4d18-8f83-622ac654ec39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.189911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096609f-6227-4d18-8f83-622ac654ec39 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.190180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096609f-6227-4d18-8f83-622ac654ec39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.190441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096609f-6227-4d18-8f83-622ac654ec39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.191072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096609f-6227-4d18-8f83-622ac654ec39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.192834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096609f-6227-4d18-8f83-622ac654ec39 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.194556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 786/1565] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:51.195350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.205985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a47c4-6af6-4554-ae6c-a9909ae7a2eb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.210689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.211196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 780/1566] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.211322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.211546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.211812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.212423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.212544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:51.212859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.213100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.213380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.214462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.227775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 787/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:51.228484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.234663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.235782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.238113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a615a-1892-4eef-a33c-1c14a82af2e4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.242579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.243187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.243462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.243733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.244360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:51.244504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 781/1568] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.244842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.245255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.246279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.255243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ca8f8-d589-4bd6-b082-b81489352452 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.258868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 788/1569] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:51.259777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.260705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.261308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.261611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.261876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.262513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.264110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.269557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd20e0-8e85-448a-845d-1b3c6866f4d5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.274244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.274830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.275104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.275260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 782/1570] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.275412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.276018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.276136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:51.276319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.277926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.287721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b3c35-70ef-43a4-8567-bcc877593d4a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.297321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 789/1571] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:51.297321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.297588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.297588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.297588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.297588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.298003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.298003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.303529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc74d7f-f65d-443f-ae94-7f05fe93356b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.309166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.309791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.310160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.310464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.311081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.313196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.321754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 783/1572] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.321754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.329343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a43468-217b-4cb2-8eef-e7a0e1b724e3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.334920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.335538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.335835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.336088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] PATH_INFO: `/v3/projects/6346af9feaf54974bbd128e95704eb24/users/9b25d069dee74f6a90291bf2cef29de4/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.345941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 790/1573] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.346888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.351907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6346af9feaf54974bbd128e95704eb24, user_id=9b25d069dee74f6a90291bf2cef29de4, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.354703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.370139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 784/1574] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:51 2022] PUT /identity/v3/projects/6346af9feaf54974bbd128e95704eb24/users/9b25d069dee74f6a90291bf2cef29de4/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:51.370871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.410889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3da6ae-d281-4cd9-b8ab-a4eb20a79bab admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.433887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1140e-4c3c-4b8f-b877-f68f61c26853 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.439079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.439690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.439971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.440234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.440910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:21:51.441212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.442809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.459162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 785/1575] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:21:51.459981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.468701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.469315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.469591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.469857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.470476 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.472391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.475220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cca4b9-b830-4fef-b069-7610ec9b4e84 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.479764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.480354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.480794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.481060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.482073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.483588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.500510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 791/1576] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.501550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.506728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.514079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 786/1577] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.518014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.547436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.565888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6951d-58fd-4b50-a0ff-f886f4771bb9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.580123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fb09b-5344-4d84-9378-8f3c20b925d8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.584826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.585430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.585699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.585959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.586577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.588510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.617684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 787/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.618579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.621922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.622608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.623045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.623177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] PATH_INFO: `/v3/projects/a8109e69a4864a8596c9f0fa0ee8ee7c/users/0906c76a5736435cab4892b22bd62be8/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.639681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8109e69a4864a8596c9f0fa0ee8ee7c, user_id=0906c76a5736435cab4892b22bd62be8, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.641510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:21:51.641510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:21:51.641510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:21:51.643503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.660522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 792/1579] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:51 2022] PUT /identity/v3/projects/a8109e69a4864a8596c9f0fa0ee8ee7c/users/0906c76a5736435cab4892b22bd62be8/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:51.661384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.687785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743912c-961f-45b6-8093-dbf0b6ac687b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.727984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88e846-ace2-408b-86ff-e1d0a04f0717 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.732964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.734556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.734556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.734556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.742732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.742732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.747577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5970-67c2-4eed-8661-731724bdfc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.748297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5970-67c2-4eed-8661-731724bdfc22 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.748496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5970-67c2-4eed-8661-731724bdfc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.748767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5970-67c2-4eed-8661-731724bdfc22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.749900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5970-67c2-4eed-8661-731724bdfc22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.751654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5970-67c2-4eed-8661-731724bdfc22 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.763458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 788/1580] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.766257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 793/1581] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.767541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.767986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280166-7656-4a73-b769-03e41c3550ee None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.768270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280166-7656-4a73-b769-03e41c3550ee None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.768563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da280166-7656-4a73-b769-03e41c3550ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.780526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663004e-2db7-42f5-a432-a07a78bc952e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.786292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.786891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.787163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.787426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.788066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.790046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.797198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-da280166-7656-4a73-b769-03e41c3550ee None None] MFA Rules not processed for user `9b25d069dee74f6a90291bf2cef29de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.798478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-da280166-7656-4a73-b769-03e41c3550ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.814298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.822165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 794/1582] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.823037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.845860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:51.869877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 789/1583] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.870920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da280166-7656-4a73-b769-03e41c3550ee None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.885178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da280166-7656-4a73-b769-03e41c3550ee None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.886113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fa847-879a-4d22-a9d8-ec76cf1f686e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.891637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.892041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb562-ddf9-4de0-81e9-dc714eec1f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.892454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.892727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.892837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb562-ddf9-4de0-81e9-dc714eec1f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.892988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.893096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb562-ddf9-4de0-81e9-dc714eec1f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.893453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb562-ddf9-4de0-81e9-dc714eec1f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.893609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.894067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbb562-ddf9-4de0-81e9-dc714eec1f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.895522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.895953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbb562-ddf9-4de0-81e9-dc714eec1f58 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.923104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 790/1584] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.923296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 795/1585] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.923413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.923506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.923506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.923506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.933989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f54ed-3b9d-4cc3-9eae-86c194044090 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.938639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.939235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.939505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.939766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.940404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.941605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:51.942308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.942792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:51.951175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 796/1586] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:51.953261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.963531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f7437-90ad-4e5f-9fcc-b2188648e4b9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.970805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 791/1587] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:51.970978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.971106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.971202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.971202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.971202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.971202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.972033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.978816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530df91e-b4c7-42e1-ad90-05469e7818fc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:51.982436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 797/1588] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:51.983643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:51.984230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:51.984540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:51.984800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:51.985743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:51.986277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:51.987342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:51.995763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfd42-93a0-48fc-981c-5857ba40fd13 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.000936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 792/1589] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.000936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.003891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.004677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.005322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.005582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.006201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.008120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.031520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 798/1590] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:51 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:52.032354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.041707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ab700-defc-4b99-8b2f-6fc19acd67d3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.046952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.047650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.047925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.048195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.048875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.050460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.057735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d19fb-05ea-4cbb-9653-1761f62819bb admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.061327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.061950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.062415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.062554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 799/1591] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.062687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.063309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.072743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a6abe-2dd8-4d52-ae50-74a57f8f9f87 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.077390 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.077960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.078237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.078506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.079161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.080778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.090534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 800/1592] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.094636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.121173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.122407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.131504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 793/1593] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:52.132363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.142442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc3937-e040-44c3-baba-e2050c970051 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.146973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.147611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.147882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.148145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.148918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.150510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.150933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c14dd-f070-44df-88ab-7eebd93c80f8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.155913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.156558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.156831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.157097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.161319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 794/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.162290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.168019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.169573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.172156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62e74-e427-4554-99c9-9dd98b98d72d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.177056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.177647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.177924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.178190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] PATH_INFO: `/v3/projects/eec8510663e74669969800e60e6c422b/users/7dcda8b6ba32416c86b329e2a4ee41e5/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.182165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 801/1595] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:52.184004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.195842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec8510663e74669969800e60e6c422b, user_id=7dcda8b6ba32416c86b329e2a4ee41e5, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.196885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f40fea-97b1-4038-99df-5fdbfc235a53 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.198551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.203222 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.204220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.204592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.204891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.205920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.207668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.216237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 795/1596] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/eec8510663e74669969800e60e6c422b/users/7dcda8b6ba32416c86b329e2a4ee41e5/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.217286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.228817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 802/1597] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.229947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.244726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:52.245869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b988d-88ed-4e7d-9a1e-5b8019108074 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.276690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:52.303134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0226b32-713b-4de6-9525-523d2acaec4a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.309033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.309764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.310223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.310710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.311612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.313394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.326465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.327253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.327627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.328416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.328904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.330868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.331879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 796/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.333355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.344922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 803/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.346436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.349900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbfc40-7af8-4748-8186-3e4bba31b8e8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.357059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9513207-f1ba-4c04-a544-5d38e09c9808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.357959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513207-f1ba-4c04-a544-5d38e09c9808 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.358805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513207-f1ba-4c04-a544-5d38e09c9808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.359676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9513207-f1ba-4c04-a544-5d38e09c9808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.360223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9513207-f1ba-4c04-a544-5d38e09c9808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.361721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a06a2-d931-4611-a9ab-7ed050988b76 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.362429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9513207-f1ba-4c04-a544-5d38e09c9808 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.374222 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.379584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 797/1600] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.379584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.379584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.379584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.385449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.385855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.386132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.388314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.395953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.399576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:52.400819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:52.409700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 804/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.411939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.419442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 798/1602] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:52.420241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.434636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2c17-a223-4b22-8d41-45d49d68aead admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.436406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0657a-fbd7-4f3c-956d-f32ce8410210 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.445591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.446359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.446671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.447349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.447898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.448159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.448483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.448821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] PATH_INFO: `/v3/projects/cffa9ae943de44bc8264914e39c80cfa/users/c8982b93df5744bbbdeb7a956df06502/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.449181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.450830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.462432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 799/1603] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:52.462971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.474583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffa9ae943de44bc8264914e39c80cfa, user_id=c8982b93df5744bbbdeb7a956df06502, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.474754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef3e3d-f679-43e7-a048-59583c9721d1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.477565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.480603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.481333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.481803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.482402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] PATH_INFO: `/v3/projects/552997fc022d45bb9f68f6886bfd243f/users/e18670b2e8bf4d088f392468446ed584/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.497309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 805/1604] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/cffa9ae943de44bc8264914e39c80cfa/users/c8982b93df5744bbbdeb7a956df06502/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.498145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.503643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=552997fc022d45bb9f68f6886bfd243f, user_id=e18670b2e8bf4d088f392468446ed584, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.507550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.540680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 800/1605] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/552997fc022d45bb9f68f6886bfd243f/users/e18670b2e8bf4d088f392468446ed584/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.540680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.591039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0698eb-5458-4231-9a76-ada23d8074cb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.628907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a179a3-b637-4eaa-80fd-faf6ce700a6f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.636989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.637857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.638967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.639298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] PATH_INFO: `/v3/projects/47b9057e7d514e6dbe0c358cce79e61a/users/adadf92bd9ec48dfbb4eb5977edab923/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.660577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b9057e7d514e6dbe0c358cce79e61a, user_id=adadf92bd9ec48dfbb4eb5977edab923, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.663646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.664670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.665431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.665712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.666102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] PATH_INFO: `/v3/projects/165753fa104042f4bccfdfe887c11f8c/users/f56389baf3d84c509fb601ac8f3d4bf8/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.686995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 801/1606] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/47b9057e7d514e6dbe0c358cce79e61a/users/adadf92bd9ec48dfbb4eb5977edab923/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.691606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.692049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165753fa104042f4bccfdfe887c11f8c, user_id=f56389baf3d84c509fb601ac8f3d4bf8, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.693369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:52.694893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.715783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 806/1607] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/165753fa104042f4bccfdfe887c11f8c/users/f56389baf3d84c509fb601ac8f3d4bf8/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.716400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:52.740044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:52.785152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:52.816562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921cce0-fce5-42b7-95b2-304f3b604087 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.820920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74fe0b-db1f-47f0-ac47-15a989f37bfd admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:52.822746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a31cf-0789-4166-9476-c07ef2f8f785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.823615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a31cf-0789-4166-9476-c07ef2f8f785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.824026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a31cf-0789-4166-9476-c07ef2f8f785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.824463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a31cf-0789-4166-9476-c07ef2f8f785 admin admin] PATH_INFO: `/v3/projects/25f51668a0b04e4f9e51d6356b854c7b/users/ebf95a8321a249c48d1e7f0b39a067d3/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.846994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a31cf-0789-4166-9476-c07ef2f8f785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f51668a0b04e4f9e51d6356b854c7b, user_id=ebf95a8321a249c48d1e7f0b39a067d3, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.851427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a31cf-0789-4166-9476-c07ef2f8f785 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.874340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 807/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:52 2022] PUT /identity/v3/projects/25f51668a0b04e4f9e51d6356b854c7b/users/ebf95a8321a249c48d1e7f0b39a067d3/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:52.876460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeaa9f-f7ca-47bc-81a6-b3a692452fa6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.877104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeaa9f-f7ca-47bc-81a6-b3a692452fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.877472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeaa9f-f7ca-47bc-81a6-b3a692452fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.902750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-edbeaa9f-f7ca-47bc-81a6-b3a692452fa6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:52.907178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-edbeaa9f-f7ca-47bc-81a6-b3a692452fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:52.934471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a51c95-6425-42e0-b867-528dc6fb8e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:52.935906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51c95-6425-42e0-b867-528dc6fb8e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.936495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51c95-6425-42e0-b867-528dc6fb8e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.937367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a51c95-6425-42e0-b867-528dc6fb8e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.950563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a51c95-6425-42e0-b867-528dc6fb8e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:52.952496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a51c95-6425-42e0-b867-528dc6fb8e0a service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:52.967216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 802/1609] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:52.968833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf87b-604a-4177-88ad-c0511d7cf696 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.969205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf87b-604a-4177-88ad-c0511d7cf696 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.969436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf87b-604a-4177-88ad-c0511d7cf696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:52.996408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 808/1610] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:52.997959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d642-6fa5-42de-ac34-f0bd965586e9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:52.998243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d642-6fa5-42de-ac34-f0bd965586e9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:52.998513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485d642-6fa5-42de-ac34-f0bd965586e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.015128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6b7bf87b-604a-4177-88ad-c0511d7cf696 None None] MFA Rules not processed for user `e18670b2e8bf4d088f392468446ed584`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.016703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6b7bf87b-604a-4177-88ad-c0511d7cf696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.021655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d485d642-6fa5-42de-ac34-f0bd965586e9 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.022858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d485d642-6fa5-42de-ac34-f0bd965586e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.031435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 809/1611] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.033106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.033457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.033803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.065142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] MFA Rules not processed for user `f56389baf3d84c509fb601ac8f3d4bf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.066591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.106782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 803/1612] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.109737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.110014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.110280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.133293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.134755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.143361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 804/1613] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.144653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.159882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 810/1614] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.161328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.211368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.245057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3098f-5869-4dac-9954-49a8ca758000 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.250040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.250962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.251241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.251502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.258325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f2bad-4ede-40a4-95e9-248bd46703c0 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.264274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.265578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.266474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.267056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.268170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.269258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.281837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 805/1615] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:53.282783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.287478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.289092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.295752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8bcfb-62f1-40a0-a2cf-cbf7d5fde39c service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.301385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 811/1616] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:53.302395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.304467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac146d-ad9b-4394-979b-673de79c9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.305534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac146d-ad9b-4394-979b-673de79c9855 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.306158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac146d-ad9b-4394-979b-673de79c9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.306932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac146d-ad9b-4394-979b-673de79c9855 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.308730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac146d-ad9b-4394-979b-673de79c9855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.311751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac146d-ad9b-4394-979b-673de79c9855 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.313507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd9d8c-a6cf-4c8e-876f-80af2aba712d service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.318017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cdccd-d21a-453b-9f96-ace9f0c6ff78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.318634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdccd-d21a-453b-9f96-ace9f0c6ff78 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.318907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdccd-d21a-453b-9f96-ace9f0c6ff78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.319171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cdccd-d21a-453b-9f96-ace9f0c6ff78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.331006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdccd-d21a-453b-9f96-ace9f0c6ff78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.334174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cdccd-d21a-453b-9f96-ace9f0c6ff78 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.347138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 812/1617] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:53.349317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1752b-2a3f-4acd-b583-9fc3a58feb24 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.350066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1752b-2a3f-4acd-b583-9fc3a58feb24 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.350441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1752b-2a3f-4acd-b583-9fc3a58feb24 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.352157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 813/1618] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 9 12:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:53.355362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.355643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.355944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.370350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 806/1619] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:53.374084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.374397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.376464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.391792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] MFA Rules not processed for user `0906c76a5736435cab4892b22bd62be8`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.393066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.417437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.476248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:53.478221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:53.503153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 814/1620] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.504194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.585221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 807/1621] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:53.585924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.596489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cc6a7-be0c-4bc7-b90c-256da4270e11 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.598896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d8f31-64a6-4cb6-a01c-9fe26a5db489 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.606309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.606757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.607080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.607397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.607526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.607662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.607767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.607947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.608722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.608858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.611166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.612148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.645638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 815/1622] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:53.649015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.655602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 808/1623] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:53.661763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.665898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461c61a-d850-4a57-bc20-40e065f2790d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.700826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.738749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae1507-e13f-433e-951c-01f03a1693f8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.747518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213256-111e-4973-9222-107db2acfeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.748150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213256-111e-4973-9222-107db2acfeac admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.748455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213256-111e-4973-9222-107db2acfeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.748861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de213256-111e-4973-9222-107db2acfeac admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.749102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.749687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de213256-111e-4973-9222-107db2acfeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.749817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.749994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.750269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.751739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de213256-111e-4973-9222-107db2acfeac admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.765997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 809/1624] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:53.766848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213256-111e-4973-9222-107db2acfeac admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.777839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de213256-111e-4973-9222-107db2acfeac admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.786912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.787213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.787763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.787984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.788682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.790669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.821023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 810/1625] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:21:53 2022] POST /identity/v3/users => generated 309 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:21:53.821023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.823120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.824919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.831412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1731f5-a9db-4d70-83ad-322ad3e14a92 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.836366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.837075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.837333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.837466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 816/1626] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:53.837618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] PATH_INFO: `/v3/projects/a46448e7cb23498ebc56ff588b61ebd2/users/66b61bcee9fc45dd9a590c38f03107d0/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.838645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.850045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032513af-88ce-48ca-8d98-e8f119d12c86 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.854729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46448e7cb23498ebc56ff588b61ebd2, user_id=66b61bcee9fc45dd9a590c38f03107d0, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.855161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:53.855896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:53.856096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:53.856361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:53.857396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.857518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:53.859316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:53.872602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 817/1627] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:53.876532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.884876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 811/1628] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:53 2022] PUT /identity/v3/projects/a46448e7cb23498ebc56ff588b61ebd2/users/66b61bcee9fc45dd9a590c38f03107d0/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:53.888160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:53.904592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48613e8d-8a74-4ced-81a4-cca0aaff596f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:53.924145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:53.993220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72d5a5-5242-43d3-b59c-7d3f9bef7bc1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.001685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.002592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.003041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.003485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.004472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.008368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.028123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 812/1629] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:54.029060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.031057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.031763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.034909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.035193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] PATH_INFO: `/v3/projects/eaa544b6808049488e72c838e5306d99/users/5997cff978224645b35102454ef871b6/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.039971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403281e-5c12-4e2a-bbeb-649653be039a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.045941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0ca5b-f872-4aea-820b-f1560bc59caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.046713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ca5b-f872-4aea-820b-f1560bc59caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.047000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ca5b-f872-4aea-820b-f1560bc59caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.047268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0ca5b-f872-4aea-820b-f1560bc59caa admin admin] PATH_INFO: `/v3/projects/a46448e7cb23498ebc56ff588b61ebd2/users/66b61bcee9fc45dd9a590c38f03107d0/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.049672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0ca5b-f872-4aea-820b-f1560bc59caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46448e7cb23498ebc56ff588b61ebd2, user_id=66b61bcee9fc45dd9a590c38f03107d0, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.052355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0ca5b-f872-4aea-820b-f1560bc59caa admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.055341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa544b6808049488e72c838e5306d99, user_id=5997cff978224645b35102454ef871b6, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.060610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.064275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 813/1630] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:54 2022] PUT /identity/v3/projects/a46448e7cb23498ebc56ff588b61ebd2/users/66b61bcee9fc45dd9a590c38f03107d0/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:54.074774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fafef-0e8c-408f-9b59-0c566ae60736 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.075067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fafef-0e8c-408f-9b59-0c566ae60736 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.075313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fafef-0e8c-408f-9b59-0c566ae60736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.086585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 818/1631] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:53 2022] PUT /identity/v3/projects/eaa544b6808049488e72c838e5306d99/users/5997cff978224645b35102454ef871b6/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:54.091372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.107308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-501fafef-0e8c-408f-9b59-0c566ae60736 None None] MFA Rules not processed for user `66b61bcee9fc45dd9a590c38f03107d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:54.108848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-501fafef-0e8c-408f-9b59-0c566ae60736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.156902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:54.193280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0202ce-6b41-46b6-a150-0fadfa63e809 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.198867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb090c55-b272-4565-983c-58488d92ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.199490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090c55-b272-4565-983c-58488d92ce2c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.200042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090c55-b272-4565-983c-58488d92ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.200324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb090c55-b272-4565-983c-58488d92ce2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.201044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb090c55-b272-4565-983c-58488d92ce2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.202997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb090c55-b272-4565-983c-58488d92ce2c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.209069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 814/1632] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:54.210638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee113361-ec8d-4c48-b116-7f74720ae955 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.211275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee113361-ec8d-4c48-b116-7f74720ae955 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.211754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee113361-ec8d-4c48-b116-7f74720ae955 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.214780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 815/1633] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 9 12:21:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:54.218885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 819/1634] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:21:54.222727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee113361-ec8d-4c48-b116-7f74720ae955 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.225806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.226154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.227159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.241448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee113361-ec8d-4c48-b116-7f74720ae955 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.248048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.248803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.249241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.249542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] PATH_INFO: `/v3/projects/eaa544b6808049488e72c838e5306d99/users/5997cff978224645b35102454ef871b6/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.250636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:54.251573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa544b6808049488e72c838e5306d99, user_id=5997cff978224645b35102454ef871b6, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.251842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:54.254732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.271449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 816/1635] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:21:54 2022] PUT /identity/v3/projects/eaa544b6808049488e72c838e5306d99/users/5997cff978224645b35102454ef871b6/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:21:54.271449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.339400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 820/1636] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:54.356242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.363254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445ad7-91f7-487c-9438-4126bcf1745a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.369409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.370036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.370361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.370629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.403742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:54.445903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.447487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.460661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7e9fb-ea55-4188-8a38-472e396e6ced None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.461610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 817/1637] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:54.464921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d43acc-bc73-4d45-9c6a-64ca3ee1d565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.466038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43acc-bc73-4d45-9c6a-64ca3ee1d565 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.466365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43acc-bc73-4d45-9c6a-64ca3ee1d565 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.466689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d43acc-bc73-4d45-9c6a-64ca3ee1d565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.608317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:54.621872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b18368-d394-4eb6-8094-d42906f2bac9 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:54.632960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43acc-bc73-4d45-9c6a-64ca3ee1d565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.634431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b2eb0-5866-45e2-9315-57c9b2eb6140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:54.635100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b2eb0-5866-45e2-9315-57c9b2eb6140 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:54.636628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d43acc-bc73-4d45-9c6a-64ca3ee1d565 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.636839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b2eb0-5866-45e2-9315-57c9b2eb6140 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:54.637125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b2eb0-5866-45e2-9315-57c9b2eb6140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:54.649938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 821/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:21:54.743689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b2eb0-5866-45e2-9315-57c9b2eb6140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:54.745320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b2eb0-5866-45e2-9315-57c9b2eb6140 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:54.784842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 818/1639] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:55.543978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8707a8-2ebf-4de3-b7f0-c0fcded44cd0 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.544499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8707a8-2ebf-4de3-b7f0-c0fcded44cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.544976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8707a8-2ebf-4de3-b7f0-c0fcded44cd0 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.548173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 822/1640] 10.222.0.60 () {54 vars in 962 bytes} [Tue Aug 9 12:21:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:55.556434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9b7a-b1e7-4442-b77b-d6f3f54dbbfc None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.557014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9b7a-b1e7-4442-b77b-d6f3f54dbbfc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.557477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab9b7a-b1e7-4442-b77b-d6f3f54dbbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.588158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-73ab9b7a-b1e7-4442-b77b-d6f3f54dbbfc None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:55.589719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-73ab9b7a-b1e7-4442-b77b-d6f3f54dbbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:55.608941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 819/1641] 10.222.0.60 () {58 vars in 1059 bytes} [Tue Aug 9 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:21:55.613108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23149-9550-43a8-adb0-93932fa4e2ff None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.613532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23149-9550-43a8-adb0-93932fa4e2ff None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.614012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23149-9550-43a8-adb0-93932fa4e2ff None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.615948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 823/1642] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 9 12:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:21:55.629562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefb402-c1ae-4065-927f-89f7fd612815 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.631836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefb402-c1ae-4065-927f-89f7fd612815 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.632302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefb402-c1ae-4065-927f-89f7fd612815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.668875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7eefb402-c1ae-4065-927f-89f7fd612815 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:55.672503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7eefb402-c1ae-4065-927f-89f7fd612815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:55.701857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 820/1643] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:55.707661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23149-9550-43a8-adb0-93932fa4e2ff None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:21:55.725606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23149-9550-43a8-adb0-93932fa4e2ff None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:21:55.730654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4850fd-0c06-49dc-8be2-1cd60c34a90e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:21:55.734417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4850fd-0c06-49dc-8be2-1cd60c34a90e service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:55.735198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4850fd-0c06-49dc-8be2-1cd60c34a90e service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:55.735681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4850fd-0c06-49dc-8be2-1cd60c34a90e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:55.750506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:21:55.753618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4850fd-0c06-49dc-8be2-1cd60c34a90e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:21:55.756131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4850fd-0c06-49dc-8be2-1cd60c34a90e service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:21:55.794913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 824/1644] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:21:56.922404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e009f-cbc5-40a6-ab5e-f41e7b9e76a4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:56.922404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e009f-cbc5-40a6-ab5e-f41e7b9e76a4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:56.922404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e009f-cbc5-40a6-ab5e-f41e7b9e76a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:56.922404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ab8e009f-cbc5-40a6-ab5e-f41e7b9e76a4 None None] MFA Rules not processed for user `5997cff978224645b35102454ef871b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:21:56.922404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ab8e009f-cbc5-40a6-ab5e-f41e7b9e76a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:21:57.140098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 821/1645] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:21:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:21:59.994199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcec9-8241-4d2a-a47c-0f81899f64ed None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:21:59.995195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcec9-8241-4d2a-a47c-0f81899f64ed None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:21:59.995821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdcec9-8241-4d2a-a47c-0f81899f64ed None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:21:59.997887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 825/1646] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:21:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:00.009757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6156e-f874-44db-8d43-58ce6670359c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.010785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6156e-f874-44db-8d43-58ce6670359c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.011282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6156e-f874-44db-8d43-58ce6670359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.089755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ddb6156e-f874-44db-8d43-58ce6670359c None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:00.091874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ddb6156e-f874-44db-8d43-58ce6670359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:00.169092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:00.267894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 822/1647] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:00.310122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcec9-8241-4d2a-a47c-0f81899f64ed None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:00.327281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdcec9-8241-4d2a-a47c-0f81899f64ed None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:00.335201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f9ac6-fc41-48f0-a836-3128aa9b83d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:00.337371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9ac6-fc41-48f0-a836-3128aa9b83d9 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:00.337880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9ac6-fc41-48f0-a836-3128aa9b83d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:00.338354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f9ac6-fc41-48f0-a836-3128aa9b83d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:00.365514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f9ac6-fc41-48f0-a836-3128aa9b83d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:00.369864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f9ac6-fc41-48f0-a836-3128aa9b83d9 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:00.409790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 826/1648] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:02.201796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166101-2a41-483f-bcde-f5d8b343834b None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.203115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166101-2a41-483f-bcde-f5d8b343834b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.203115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18166101-2a41-483f-bcde-f5d8b343834b None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.203763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 823/1649] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:02.300078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.301031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.301482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.350905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:02.352657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:02.379607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 827/1650] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:02.437572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166101-2a41-483f-bcde-f5d8b343834b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:02.462008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18166101-2a41-483f-bcde-f5d8b343834b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:02.470956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:02.471578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.471847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.472107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.518468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.520132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.548242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 824/1651] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:02.637128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:02.795253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba7209-d54d-4aa9-b232-266db236dbd7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:02.807616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:02.808294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:02.808602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:02.808881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] PATH_INFO: `/v3/users/0906c76a5736435cab4892b22bd62be8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:02.814702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0906c76a5736435cab4892b22bd62be8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:02.815787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: WARNING py.warnings [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:22:02.815787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: warnings.warn(msg) Aug 09 12:22:02.815787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: Aug 09 12:22:02.817062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:02.949695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0906c76a5736435cab4892b22bd62be8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:02.961175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0906c76a5736435cab4892b22bd62be8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:02.979241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0906c76a5736435cab4892b22bd62be8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:02.980069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0906c76a5736435cab4892b22bd62be8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.007616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0906c76a5736435cab4892b22bd62be8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:03.016233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 828/1652] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:02 2022] DELETE /identity/v3/users/0906c76a5736435cab4892b22bd62be8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:03.887205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:03.906601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694ba9a-614d-498c-ab03-441733cae43a service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.054793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.059735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.060214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.063537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] PATH_INFO: `/v3/projects/a8109e69a4864a8596c9f0fa0ee8ee7c` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.065781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8109e69a4864a8596c9f0fa0ee8ee7c)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.068996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: WARNING py.warnings [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 12:22:04.068996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: warnings.warn(msg) Aug 09 12:22:04.068996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: Aug 09 12:22:04.072215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.232492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8109e69a4864a8596c9f0fa0ee8ee7c', 'request_id': 'req-28629712-e858-438d-8013-ab9c59f3ce81'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.255576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8109e69a4864a8596c9f0fa0ee8ee7c', 'request_id': 'req-28629712-e858-438d-8013-ab9c59f3ce81'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.297928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8109e69a4864a8596c9f0fa0ee8ee7c', 'request_id': 'req-28629712-e858-438d-8013-ab9c59f3ce81'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.329368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] The token cache is being invalidate because project a8109e69a4864a8596c9f0fa0ee8ee7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:04.329668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.331711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28629712-e858-438d-8013-ab9c59f3ce81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.335347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 825/1653] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:03 2022] DELETE /identity/v3/projects/a8109e69a4864a8596c9f0fa0ee8ee7c => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:04.343210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.345809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.385611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7da42-4760-44d2-908f-6cc0d3bd6a76 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:04.387004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.387288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.387568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.443584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] MFA Rules not processed for user `c8982b93df5744bbbdeb7a956df06502`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:04.445251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.537083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:04.537949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:04.570427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:04.571410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:04.574496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:04.574949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] PATH_INFO: `/v3/users/5997cff978224645b35102454ef871b6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:04.578514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5997cff978224645b35102454ef871b6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:04.580699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:04.646921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 826/1654] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:04.647958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:04.666383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:04.732975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5997cff978224645b35102454ef871b6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.766203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5997cff978224645b35102454ef871b6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.783818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5997cff978224645b35102454ef871b6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.791652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5997cff978224645b35102454ef871b6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.833412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5997cff978224645b35102454ef871b6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:04.867862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 829/1655] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:04 2022] DELETE /identity/v3/users/5997cff978224645b35102454ef871b6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:04.892975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f633-3391-4fd0-bf2d-59b3ecffc7ec None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.043936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.044642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.045048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.045205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.056795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:05.231800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.234187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786092b-9390-4996-911d-4b83fbe84975 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:05.256294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 827/1656] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:05.752635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:05.754110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:05.951712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22d05c-1321-4372-a77e-54638eba9398 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:05.966435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:05.967217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:05.967561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:05.967834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] PATH_INFO: `/v3/projects/eaa544b6808049488e72c838e5306d99` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:05.969119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa544b6808049488e72c838e5306d99)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:05.971055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.098841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa544b6808049488e72c838e5306d99', 'request_id': 'req-3ad74204-ffff-4a38-82fb-ca35519b158b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.142003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa544b6808049488e72c838e5306d99', 'request_id': 'req-3ad74204-ffff-4a38-82fb-ca35519b158b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.157180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa544b6808049488e72c838e5306d99', 'request_id': 'req-3ad74204-ffff-4a38-82fb-ca35519b158b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.178007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] The token cache is being invalidate because project eaa544b6808049488e72c838e5306d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:06.178190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.180797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3ad74204-ffff-4a38-82fb-ca35519b158b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:06.182669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 830/1657] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:05 2022] DELETE /identity/v3/projects/eaa544b6808049488e72c838e5306d99 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:06.187610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.188101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.188174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.234090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:06.236229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:06.246074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:06.360566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 828/1658] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:06.368601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.368885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.369150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.381225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:06.426159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:06.429933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:06.452772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.453621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 831/1659] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:06.467541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e65d23-8604-432b-84ab-3b0cfd021c79 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.479713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.480975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.482733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.482913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.483557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:06.485212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:06.488734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.526804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 829/1660] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:22:06.531817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.546747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d131877-4abb-4a39-baff-f7a23bdf450a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.564759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.565753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.566038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.574771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.577289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:06.579287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.679730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 832/1661] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:06 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:06.680470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.707166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4df0f-f85b-4071-bdd3-38bb782247eb admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.856055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.856880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.857167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.857438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:06.858142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:06.860178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:06.957259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 830/1662] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:06 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:06.961245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:06.972914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7ed60-fa5d-4566-8118-ae4d235d0b5d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:06.997014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:06.997667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:06.997947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:06.998201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.001351 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.002996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.097617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 833/1663] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:07.109322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.131696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73157b-b4c2-44fc-84b3-e3b86ef51c9a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.147669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaacc9-ac16-4321-8d37-6af9748e58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.148611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaacc9-ac16-4321-8d37-6af9748e58f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.149050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaacc9-ac16-4321-8d37-6af9748e58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.149446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaacc9-ac16-4321-8d37-6af9748e58f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.150245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaacc9-ac16-4321-8d37-6af9748e58f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.152246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebaacc9-ac16-4321-8d37-6af9748e58f1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.192951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.206131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ea1a8-516d-4b28-9e77-04b730f4f949 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.206518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 831/1664] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:07.212443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.213737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.214026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.214298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] PATH_INFO: `/v3/projects/ee24e2f2cf094efb84a99d08f342e821/users/f137a86c262f462c87256329f7d19550/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.248128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee24e2f2cf094efb84a99d08f342e821, user_id=f137a86c262f462c87256329f7d19550, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.251100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.300126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb43df4-697d-43b1-be90-38545034d21a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.300774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb43df4-697d-43b1-be90-38545034d21a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.301205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb43df4-697d-43b1-be90-38545034d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.309166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 834/1665] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:07 2022] PUT /identity/v3/projects/ee24e2f2cf094efb84a99d08f342e821/users/f137a86c262f462c87256329f7d19550/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:07.358831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-beb43df4-697d-43b1-be90-38545034d21a None None] MFA Rules not processed for user `f137a86c262f462c87256329f7d19550`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:07.363706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-beb43df4-697d-43b1-be90-38545034d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:07.664529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 832/1666] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:07.669254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.796947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65cebf-473a-4b3f-8cd0-77e7d9cee030 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.813915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:07.814689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:07.814689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:07.814863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:07.815491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:07.817465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:07.878977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 835/1667] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:07 2022] POST /identity/v3/projects => generated 365 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:07.883847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb43df4-697d-43b1-be90-38545034d21a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:07.935218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb43df4-697d-43b1-be90-38545034d21a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:07.941357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:08.070162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.071411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.071791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.072160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.074847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.086395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.149712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.150257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 833/1668] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:07 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:08.168595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bbf44-d2f0-43f5-b89d-565b3fce961c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.198200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.199506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.199985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.200484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.201333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.203340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.220370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 836/1669] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:08.224777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.235334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daecbff-50dd-4320-89e2-01acc67a6af6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.240344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.241150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.241625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.242073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] PATH_INFO: `/v3/projects/a6879cde959b49e791c28060ab4d3a83/users/0254e63ce8224da5a1df5f9136a568d0/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.261936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6879cde959b49e791c28060ab4d3a83, user_id=0254e63ce8224da5a1df5f9136a568d0, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.265825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.293052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.298833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 834/1670] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:08 2022] PUT /identity/v3/projects/a6879cde959b49e791c28060ab4d3a83/users/0254e63ce8224da5a1df5f9136a568d0/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:08.308529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5492a8-fb46-45db-a2c9-db4cd632bed0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.450919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf96a-2064-414b-afd0-2277b15dc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.451775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf96a-2064-414b-afd0-2277b15dc5fc admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.452077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf96a-2064-414b-afd0-2277b15dc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.452343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf96a-2064-414b-afd0-2277b15dc5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.455418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf96a-2064-414b-afd0-2277b15dc5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.459509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cf96a-2064-414b-afd0-2277b15dc5fc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.489962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.492584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 837/1671] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:08.517543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42bd14-ad3b-4650-913b-df5228cfe3de admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:08.542727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9e3e-a4e3-4602-9c87-e40dad99634b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.542919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9e3e-a4e3-4602-9c87-e40dad99634b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.543248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9e3e-a4e3-4602-9c87-e40dad99634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.571031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a9faa-b46c-48df-8011-4e3ccc3489cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:08.571995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9faa-b46c-48df-8011-4e3ccc3489cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.574687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9faa-b46c-48df-8011-4e3ccc3489cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.575134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a9faa-b46c-48df-8011-4e3ccc3489cc admin admin] PATH_INFO: `/v3/projects/a6879cde959b49e791c28060ab4d3a83/users/0254e63ce8224da5a1df5f9136a568d0/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.578550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9faa-b46c-48df-8011-4e3ccc3489cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6879cde959b49e791c28060ab4d3a83, user_id=0254e63ce8224da5a1df5f9136a568d0, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:08.581885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:08.595657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a9faa-b46c-48df-8011-4e3ccc3489cc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:08.601598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-005c9e3e-a4e3-4602-9c87-e40dad99634b None None] MFA Rules not processed for user `7dcda8b6ba32416c86b329e2a4ee41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:08.606526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-005c9e3e-a4e3-4602-9c87-e40dad99634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.615386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 835/1672] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:08 2022] PUT /identity/v3/projects/a6879cde959b49e791c28060ab4d3a83/users/0254e63ce8224da5a1df5f9136a568d0/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:08.627892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.628820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.629290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.688079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] MFA Rules not processed for user `0254e63ce8224da5a1df5f9136a568d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:08.689658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.759812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 838/1673] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:08.771066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:08.774122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:08.774625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:08.853764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] MFA Rules not processed for user `7dcda8b6ba32416c86b329e2a4ee41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:08.855022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.903241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 839/1674] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:08.921443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.929405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:08.962874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 836/1675] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:08.993042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:08.996895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.181073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:09.211239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4350c8-0053-430e-80d2-66c313abadbc None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.216619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2f08-a67a-4aaa-ac22-e46431b6fead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.217409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2f08-a67a-4aaa-ac22-e46431b6fead service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.217594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2f08-a67a-4aaa-ac22-e46431b6fead service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.217870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2f08-a67a-4aaa-ac22-e46431b6fead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.235366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f2f08-a67a-4aaa-ac22-e46431b6fead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.236350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f2f08-a67a-4aaa-ac22-e46431b6fead service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.250433 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 837/1676] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:09.251794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.252084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.252358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.294811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] MFA Rules not processed for user `adadf92bd9ec48dfbb4eb5977edab923`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:09.296160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.388007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55cbb1-66c9-4f75-9227-a744e62cca69 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.422628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.423334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.423608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.423866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.446366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.447992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.470714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 840/1677] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:09.471813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.488754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e43c8-dbf6-4693-a3c9-41e2744b96d1 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.499698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ab9a-b5ff-4740-9acf-1b35eb97a81b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.500140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ab9a-b5ff-4740-9acf-1b35eb97a81b service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.500484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ab9a-b5ff-4740-9acf-1b35eb97a81b service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.500757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ab9a-b5ff-4740-9acf-1b35eb97a81b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.527241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 838/1678] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:09.631793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ab9a-b5ff-4740-9acf-1b35eb97a81b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.633348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ab9a-b5ff-4740-9acf-1b35eb97a81b service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.644355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 841/1679] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:09.718048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:09.718048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:09.774449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea99a4d-050c-4708-9e82-80f36db78034 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:09.785673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d616eb4-1639-4ec7-8186-ff0648dd786a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:09.786337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d616eb4-1639-4ec7-8186-ff0648dd786a service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.786613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d616eb4-1639-4ec7-8186-ff0648dd786a service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.786888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d616eb4-1639-4ec7-8186-ff0648dd786a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:09.811577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d616eb4-1639-4ec7-8186-ff0648dd786a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:09.827126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d616eb4-1639-4ec7-8186-ff0648dd786a service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:09.859727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 839/1680] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:09.959913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:09.960193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:09.960611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.047626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] MFA Rules not processed for user `ebf95a8321a249c48d1e7f0b39a067d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:10.051889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.060984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:10.234574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 842/1681] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:10.246558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f392c-52a2-4f6d-af24-9a885d4f846e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.247020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f392c-52a2-4f6d-af24-9a885d4f846e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.247101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f392c-52a2-4f6d-af24-9a885d4f846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.292103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-077f392c-52a2-4f6d-af24-9a885d4f846e None None] MFA Rules not processed for user `ebf95a8321a249c48d1e7f0b39a067d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:10.293533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-077f392c-52a2-4f6d-af24-9a885d4f846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.313221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 840/1682] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:10.418672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.444299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564235e7-c9a2-40bd-833e-c8153a48b8f3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.458293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.459085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.459739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.460121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.471134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425251c-609a-402e-90c8-8c7fa9becc75 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.471278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425251c-609a-402e-90c8-8c7fa9becc75 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.471549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e425251c-609a-402e-90c8-8c7fa9becc75 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.473287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 841/1683] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 9 12:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:10.473961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.476063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.480752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7313d-be0d-4791-a2cb-32f52798e519 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.481302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7313d-be0d-4791-a2cb-32f52798e519 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.481717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7313d-be0d-4791-a2cb-32f52798e519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.489739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 843/1684] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:10.559356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e1e7313d-be0d-4791-a2cb-32f52798e519 None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:10.561000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e1e7313d-be0d-4791-a2cb-32f52798e519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.691926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 842/1685] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:10.928427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:10.930315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:10.945589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d2003-3e11-4220-a145-e360da9a6b69 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.946110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d2003-3e11-4220-a145-e360da9a6b69 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.946381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d2003-3e11-4220-a145-e360da9a6b69 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.948810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 843/1686] 10.222.0.60 () {54 vars in 912 bytes} [Tue Aug 9 12:22:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:10.950355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b27e-f50e-49bc-bf2b-8c371f90bd02 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:10.954956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:10.956004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.956800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.957895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.958113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691568-f3d0-49de-b1dc-37f2663b4668 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:10.961163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691568-f3d0-49de-b1dc-37f2663b4668 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:10.961469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c691568-f3d0-49de-b1dc-37f2663b4668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:10.968500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:10.970719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:10.981392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 844/1687] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:11.018333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-8c691568-f3d0-49de-b1dc-37f2663b4668 None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:11.020685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8c691568-f3d0-49de-b1dc-37f2663b4668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:11.040673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 844/1688] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:11.085047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:11.094803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc954af-1708-4c3a-9344-7b67e1fd45bc service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:11.113033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92653a6e-4ad0-49b6-9467-717b300bdc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:11.115615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92653a6e-4ad0-49b6-9467-717b300bdc46 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:11.116069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92653a6e-4ad0-49b6-9467-717b300bdc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:11.116517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92653a6e-4ad0-49b6-9467-717b300bdc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:11.154580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92653a6e-4ad0-49b6-9467-717b300bdc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:11.160036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92653a6e-4ad0-49b6-9467-717b300bdc46 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:11.178253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 845/1689] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:12.111313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0b35-dc2a-4bd7-9b12-971c249f3f77 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.111752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0b35-dc2a-4bd7-9b12-971c249f3f77 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.112096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d0b35-dc2a-4bd7-9b12-971c249f3f77 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.114170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 845/1690] 10.222.0.60 () {54 vars in 961 bytes} [Tue Aug 9 12:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:12.124887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.125399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.125399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.125612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.126313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.126916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.155869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] MFA Rules not processed for user `be8c3d3074604b1181652ac0c346c906`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:12.157284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.170778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] MFA Rules not processed for user `c8982b93df5744bbbdeb7a956df06502`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:12.172228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.290103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 846/1691] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:12.378309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:12.424462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 846/1692] 10.222.0.60 () {58 vars in 1058 bytes} [Tue Aug 9 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:12.434955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:12.458720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b79fa-0736-4bae-803d-c24e4afe9cdc None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:12.467026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:12.468511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.478314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:12.479206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.480343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.480973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.486416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.488153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b03ae32-47ff-4764-980d-b47a29b4fb6a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:12.507857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e867e-877e-425f-853d-65bb1a338864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:12.509196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e867e-877e-425f-853d-65bb1a338864 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.509449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e867e-877e-425f-853d-65bb1a338864 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.509711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e867e-877e-425f-853d-65bb1a338864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.520699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:12.527499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659d4a1-798b-4052-a779-75f3517c59fd service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:12.532358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e867e-877e-425f-853d-65bb1a338864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:12.541210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e867e-877e-425f-853d-65bb1a338864 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:12.559191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 847/1693] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:12.595074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 847/1694] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:12.784292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:12.785025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:12.785499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:12.848483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] MFA Rules not processed for user `7dcda8b6ba32416c86b329e2a4ee41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:12.849747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:12.881047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 848/1695] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:15.587998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a89a4-6647-4275-b965-15d1d62988a8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:15.588971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a89a4-6647-4275-b965-15d1d62988a8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:15.589418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a89a4-6647-4275-b965-15d1d62988a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:15.660724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-185a89a4-6647-4275-b965-15d1d62988a8 None None] MFA Rules not processed for user `adadf92bd9ec48dfbb4eb5977edab923`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:15.661947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-185a89a4-6647-4275-b965-15d1d62988a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.680205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 848/1696] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:15.736289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:15.738060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:15.941361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:15.997509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60534fe4-7f5a-4ed4-9604-9e2d3ae634fa None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.006084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.007095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.007826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.008347 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] PATH_INFO: `/v3/users/f56389baf3d84c509fb601ac8f3d4bf8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.009792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f56389baf3d84c509fb601ac8f3d4bf8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.012218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.137426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f56389baf3d84c509fb601ac8f3d4bf8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.169992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f56389baf3d84c509fb601ac8f3d4bf8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.185654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f56389baf3d84c509fb601ac8f3d4bf8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.187261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f56389baf3d84c509fb601ac8f3d4bf8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.203062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f56389baf3d84c509fb601ac8f3d4bf8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:16.212790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 849/1697] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:15 2022] DELETE /identity/v3/users/f56389baf3d84c509fb601ac8f3d4bf8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:16.219067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.221623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.222706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.271761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:16.273196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.429777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 849/1698] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:16.460082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:16.462252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:16.552849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a755229-5ac1-4f6b-a40d-e722073557fe admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:16.557018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49d49d-eebc-438b-8fca-135f65c71995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:16.558184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d49d-eebc-438b-8fca-135f65c71995 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:16.558562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d49d-eebc-438b-8fca-135f65c71995 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:16.558732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49d49d-eebc-438b-8fca-135f65c71995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:16.572116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49d49d-eebc-438b-8fca-135f65c71995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:16.574411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49d49d-eebc-438b-8fca-135f65c71995 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:16.590264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 850/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:17.271523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.273681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.289040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44fed5-33a7-4f93-ad06-6c252846d5f5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.297936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.298990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.299450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.299715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] PATH_INFO: `/v3/projects/165753fa104042f4bccfdfe887c11f8c` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.301111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165753fa104042f4bccfdfe887c11f8c)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.304225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.363060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165753fa104042f4bccfdfe887c11f8c', 'request_id': 'req-ccce022b-49a9-402f-812e-be8534aa8ef1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.371743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165753fa104042f4bccfdfe887c11f8c', 'request_id': 'req-ccce022b-49a9-402f-812e-be8534aa8ef1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.380177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165753fa104042f4bccfdfe887c11f8c', 'request_id': 'req-ccce022b-49a9-402f-812e-be8534aa8ef1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.400807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] The token cache is being invalidate because project 165753fa104042f4bccfdfe887c11f8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:17.401455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.402445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ccce022b-49a9-402f-812e-be8534aa8ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:17.404089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 850/1700] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:17 2022] DELETE /identity/v3/projects/165753fa104042f4bccfdfe887c11f8c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:17.409837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.410694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.411129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.458335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:17.459557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.529837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 851/1701] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:17.537662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.538125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.538476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.596041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:17.597282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:17.626088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 851/1702] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:17.631494 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.642411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca210a-5952-4026-bad9-b182f713d911 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.647015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.647684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.648022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.648360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.649228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:17.649612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.651200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.664063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 852/1703] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:22:17.668361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.678501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df78335-bc06-49e6-9ad2-9176965120c4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.683653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.684424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.684724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.684990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.686052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.687569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.720325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 852/1704] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:17.723826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.729301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:17.736013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b86b9-fbbe-4a63-a4fd-56a66cd4cfa1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.794820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.795431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.795759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.796027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.796680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.798593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.822456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 853/1705] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:17.826716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.837324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968094c-1322-4bd5-8955-e3be747e4951 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.842474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.843236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.843513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.843801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.844463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.846068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.856484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 853/1706] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:17.860801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.871198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30154fc4-9c5c-45cc-82d0-28709fd957c4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.876535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb648e-b215-410e-967b-0c229d47fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.877137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb648e-b215-410e-967b-0c229d47fef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.877412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb648e-b215-410e-967b-0c229d47fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.877669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb648e-b215-410e-967b-0c229d47fef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.878304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb648e-b215-410e-967b-0c229d47fef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.880265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb648e-b215-410e-967b-0c229d47fef7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.896708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 854/1707] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:17.901193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:17.915934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad0c5d-68f7-4e62-9da5-5502f32643a5 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:17.921908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:17.922609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.922879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.923167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] PATH_INFO: `/v3/projects/516f456510774149b0a9394b86dacc47/users/58ddd835e20e4c1eb3e3ee1812fc0170/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:17.926147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:17.941160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516f456510774149b0a9394b86dacc47, user_id=58ddd835e20e4c1eb3e3ee1812fc0170, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:17.944173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:17.958645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 854/1708] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:17 2022] PUT /identity/v3/projects/516f456510774149b0a9394b86dacc47/users/58ddd835e20e4c1eb3e3ee1812fc0170/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:17.970884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:17.971164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:17.973357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.002397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] MFA Rules not processed for user `58ddd835e20e4c1eb3e3ee1812fc0170`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:18.003624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.069470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 855/1709] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:18.073528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.137071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5475e4-54df-40a0-812e-0e7110f05007 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.141920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.142535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.142807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.143073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.143705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.145624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.180522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 855/1710] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:18 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:18.180669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.192772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921b2d-5271-4051-88d1-b02622455c07 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.276602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.277302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.277580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.277848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.278488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.280598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.306459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:18.314130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 856/1711] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:18 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:18.318400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.330256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298ebd9-907f-4270-acd9-a8b91436aff4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.335964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.336941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.337278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.337758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.338523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.340349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.353244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 856/1712] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:18.358372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.379806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8247-3c27-4b73-b01f-b0131feb1290 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.388005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.389002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.389127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.389447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] PATH_INFO: `/v3/projects/19b799f51daf439a861b1a787e253f9c/users/09d96bcec8cb47eabcc6910c65724248/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.411555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b799f51daf439a861b1a787e253f9c, user_id=09d96bcec8cb47eabcc6910c65724248, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.415018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.431789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 857/1713] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:18 2022] PUT /identity/v3/projects/19b799f51daf439a861b1a787e253f9c/users/09d96bcec8cb47eabcc6910c65724248/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:18.435922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.447330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d0cbf-5e30-4de8-a1e7-1bca6e06e6d1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.572723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974fb5-443e-405d-8807-fd10d4a96966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.573779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974fb5-443e-405d-8807-fd10d4a96966 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.574059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974fb5-443e-405d-8807-fd10d4a96966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.574327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974fb5-443e-405d-8807-fd10d4a96966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.574975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974fb5-443e-405d-8807-fd10d4a96966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.576843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974fb5-443e-405d-8807-fd10d4a96966 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.589392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 857/1714] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:18.593949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.610342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa00a2-694e-49d9-860a-4763a5d7f299 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.621949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.622662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.623043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.623986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] PATH_INFO: `/v3/projects/19b799f51daf439a861b1a787e253f9c/users/09d96bcec8cb47eabcc6910c65724248/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.626430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b799f51daf439a861b1a787e253f9c, user_id=09d96bcec8cb47eabcc6910c65724248, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.629775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.642102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 858/1715] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:18 2022] PUT /identity/v3/projects/19b799f51daf439a861b1a787e253f9c/users/09d96bcec8cb47eabcc6910c65724248/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:18.653105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99df4eb-4965-417e-b91a-3077a296abe1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.653220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99df4eb-4965-417e-b91a-3077a296abe1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.653436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99df4eb-4965-417e-b91a-3077a296abe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.689839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c99df4eb-4965-417e-b91a-3077a296abe1 None None] MFA Rules not processed for user `09d96bcec8cb47eabcc6910c65724248`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:18.691081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c99df4eb-4965-417e-b91a-3077a296abe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.735019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:18.765738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 858/1716] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:18.776960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:18.778704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:18.843881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d906c-c35d-4c59-9a31-4a470fadb7e1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:18.847608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:18.848288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:18.848618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:18.848888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:18.859105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:18.860614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:18.871155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 859/1717] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:20.683169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:20.684096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:20.684557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:20.847064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:20.848428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:21.044446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 859/1718] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:21.334073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:21.338045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:21.642354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008934a8-c39d-4f5c-96d2-7b0c1289f789 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:21.648581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3afb06-2d37-46a0-afb5-a3977b19408c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:21.649586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afb06-2d37-46a0-afb5-a3977b19408c service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:21.650148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afb06-2d37-46a0-afb5-a3977b19408c service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:21.650656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3afb06-2d37-46a0-afb5-a3977b19408c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:21.664316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afb06-2d37-46a0-afb5-a3977b19408c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:21.668634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3afb06-2d37-46a0-afb5-a3977b19408c service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:21.702360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 860/1719] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:22:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 12:22:21.906405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:22.144404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c610-a2c0-4a60-bd65-7d42b2f88451 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:22.164353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:22.165042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.165317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.165583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] PATH_INFO: `/v3/users/58ddd835e20e4c1eb3e3ee1812fc0170` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.167513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ddd835e20e4c1eb3e3ee1812fc0170)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:22.175665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:22.362326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ddd835e20e4c1eb3e3ee1812fc0170'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.377558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:22.385341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ddd835e20e4c1eb3e3ee1812fc0170'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.386377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ddd835e20e4c1eb3e3ee1812fc0170'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.427152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ddd835e20e4c1eb3e3ee1812fc0170'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.434316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ddd835e20e4c1eb3e3ee1812fc0170'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:22.497186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 860/1720] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:21 2022] DELETE /identity/v3/users/58ddd835e20e4c1eb3e3ee1812fc0170 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:22.502321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:22.502814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:22.502911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:22.556401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:22.558443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:22.708911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:22.829180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 861/1721] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:22.914347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:22.915837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.120290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20984a9a-073c-4ba0-bb2e-cad9cb8ae9a6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:23.131194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9d25a-bfa4-48f5-a70d-d6109e98b082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:23.138233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d25a-bfa4-48f5-a70d-d6109e98b082 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.140469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d25a-bfa4-48f5-a70d-d6109e98b082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.140766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9d25a-bfa4-48f5-a70d-d6109e98b082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.166928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9d25a-bfa4-48f5-a70d-d6109e98b082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:23.191411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9d25a-bfa4-48f5-a70d-d6109e98b082 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:23.230132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 861/1722] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:23.423237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:23.424926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.448238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8e8cd-cc65-4663-bb1d-65919d13f839 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:23.460212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:23.461096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.461411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.461763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] PATH_INFO: `/v3/users/9b25d069dee74f6a90291bf2cef29de4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.471085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b25d069dee74f6a90291bf2cef29de4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:23.473224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:23.598572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b25d069dee74f6a90291bf2cef29de4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.628752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b25d069dee74f6a90291bf2cef29de4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.660345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b25d069dee74f6a90291bf2cef29de4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.661234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b25d069dee74f6a90291bf2cef29de4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.707207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b5e269d-8e65-46ae-9244-44669e69292e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b25d069dee74f6a90291bf2cef29de4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:23.737213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 862/1723] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:23 2022] DELETE /identity/v3/users/9b25d069dee74f6a90291bf2cef29de4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:23.741780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.743667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.744053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.824757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:23.825432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:23.825950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:23.835440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:23.836760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.871634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:23.873342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:23.965056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 863/1724] 10.222.0.73 () {58 vars in 1015 bytes} [Tue Aug 9 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:24.011624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.013331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.018835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 862/1725] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:24.020432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.035991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998127-a33f-482d-819f-f876fcf36af4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.047644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.048556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.049980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.050206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.058247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d59945-ed11-4dba-b459-ca0f3cdb6300 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.071352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.075744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.082847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a0548-82e4-460d-8dc3-acac81bfd3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.084004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0548-82e4-460d-8dc3-acac81bfd3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.084821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0548-82e4-460d-8dc3-acac81bfd3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.085250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0548-82e4-460d-8dc3-acac81bfd3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.091040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 864/1726] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:24.092349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.103116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78640271-f4f2-4f79-9a7a-a7eed1511082 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.108184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.108987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.109373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.109741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.117782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a0548-82e4-460d-8dc3-acac81bfd3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.119891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a0548-82e4-460d-8dc3-acac81bfd3b8 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.121069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.122709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.148650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 865/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:24.156642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 863/1728] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:24.492226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:24.494219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.526284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3fc0f-ad53-4012-ab98-6c7e53506974 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:24.545289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:24.552935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.553340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.554519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] PATH_INFO: `/v3/users/f137a86c262f462c87256329f7d19550` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.565286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f137a86c262f462c87256329f7d19550)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:24.571872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:24.631791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:24.674942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f137a86c262f462c87256329f7d19550'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.688079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f137a86c262f462c87256329f7d19550'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.712286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f137a86c262f462c87256329f7d19550'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.719554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f137a86c262f462c87256329f7d19550'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.768019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f137a86c262f462c87256329f7d19550'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:24.785420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 866/1729] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:24 2022] DELETE /identity/v3/users/f137a86c262f462c87256329f7d19550 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:24.787337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985a6b-13d0-4992-9ff3-bbf79a2daa47 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:24.787639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985a6b-13d0-4992-9ff3-bbf79a2daa47 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:24.787881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985a6b-13d0-4992-9ff3-bbf79a2daa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:24.825947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e7985a6b-13d0-4992-9ff3-bbf79a2daa47 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:24.827344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e7985a6b-13d0-4992-9ff3-bbf79a2daa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:24.972179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:24.998111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 864/1730] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:25.086066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:25.088568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:25.216887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29404e-9b77-4975-ac23-d7a616cfc47d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:25.222631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53938a1d-8603-4e65-aa08-1dcf3102f26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:25.224165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53938a1d-8603-4e65-aa08-1dcf3102f26d service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:25.224795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53938a1d-8603-4e65-aa08-1dcf3102f26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:25.225288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53938a1d-8603-4e65-aa08-1dcf3102f26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:25.238289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53938a1d-8603-4e65-aa08-1dcf3102f26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:25.244469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53938a1d-8603-4e65-aa08-1dcf3102f26d service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:25.293368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 867/1731] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:26.354231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e2fd-9a0d-4edd-88a3-661d5ca0a809 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.354909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e2fd-9a0d-4edd-88a3-661d5ca0a809 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.354909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e2fd-9a0d-4edd-88a3-661d5ca0a809 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.357009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 865/1732] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:26.414419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:26.435572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:26.435572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:26.483808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:26.487251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:26.742343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 868/1733] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:27.137846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0e2fd-9a0d-4edd-88a3-661d5ca0a809 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.140634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-aaa0e2fd-9a0d-4edd-88a3-661d5ca0a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.191894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0e2fd-9a0d-4edd-88a3-661d5ca0a809 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.208074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.209770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.210456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.210896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] PATH_INFO: `/v3/projects/6346af9feaf54974bbd128e95704eb24` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.215479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=6346af9feaf54974bbd128e95704eb24)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.224017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.370568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.372054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.386971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6346af9feaf54974bbd128e95704eb24', 'request_id': 'req-eb11ad18-1586-41a2-8164-196b19556dda'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.402921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b6ee3-159f-49e1-95c8-08fafd50bce8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.403462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6346af9feaf54974bbd128e95704eb24', 'request_id': 'req-eb11ad18-1586-41a2-8164-196b19556dda'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.438686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6346af9feaf54974bbd128e95704eb24', 'request_id': 'req-eb11ad18-1586-41a2-8164-196b19556dda'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.500156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] The token cache is being invalidate because project 6346af9feaf54974bbd128e95704eb24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:27.500643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.505058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-eb11ad18-1586-41a2-8164-196b19556dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:27.508999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 866/1734] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:27 2022] DELETE /identity/v3/projects/6346af9feaf54974bbd128e95704eb24 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:27.514173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.514696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.515118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.557283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:27.592398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:27.593639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.668238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.669148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.669703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.670132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.674059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.707346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.719835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e7b0b-0e5f-4f9d-ab9e-7e8e3146bb97 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.745769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 869/1735] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:27.768477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 867/1736] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:27.776826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.777348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.777784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.825933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:27.827213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:27.849618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 870/1737] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:27.853626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.868766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c26e7-9dfe-40bb-8d2f-85f25eff96d5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.886540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.887380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.888522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.889026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.890109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:27.890557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.892615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.913903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 868/1738] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:27.920598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:27.932245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c6fed-ccd1-41bf-8b42-74638931c027 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:27.939190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:27.940133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:27.940646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:27.940922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:27.941604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:27.943760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:27.992866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 871/1739] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:27 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:28.002218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.017647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20a77d-8fb9-4dc3-a519-a36ae22b8bc7 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.157154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.158859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.159683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.160266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.161721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.174623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.238047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:28.252626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.261715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 869/1740] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:28.274757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c716-b7e1-46e7-90c1-8908fddc397f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.297033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.297743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.298025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.298297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.304857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.307422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.384224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 872/1741] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:28.389020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.409789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033497ee-c645-4699-a43c-db57207edc72 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.424126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7468ab9-cb7c-452e-a483-730071ff3f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.437499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7468ab9-cb7c-452e-a483-730071ff3f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.438055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7468ab9-cb7c-452e-a483-730071ff3f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.439614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7468ab9-cb7c-452e-a483-730071ff3f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.442481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7468ab9-cb7c-452e-a483-730071ff3f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.448600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7468ab9-cb7c-452e-a483-730071ff3f79 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.485156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 870/1742] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:28.489026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.501995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316f079-9731-4ceb-a6be-8603678069ba admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.507971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.508890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.509536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.509955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] PATH_INFO: `/v3/projects/1b0a9a4f7fc049db90ad091a90093180/users/f1df58f362fd452293b15076f0c328a2/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.528125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0a9a4f7fc049db90ad091a90093180, user_id=f1df58f362fd452293b15076f0c328a2, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.531521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.559427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 873/1743] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:28 2022] PUT /identity/v3/projects/1b0a9a4f7fc049db90ad091a90093180/users/f1df58f362fd452293b15076f0c328a2/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:28.573115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.574060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.574904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.661908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] MFA Rules not processed for user `f1df58f362fd452293b15076f0c328a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:28.663213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.729914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.735419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:28.848787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 871/1744] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:28.856107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:28.933335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05c6bb-2ea1-42c1-bd63-7b9d1989b353 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:28.947139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:28.948187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:28.948763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:28.950713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] PATH_INFO: `/v3/projects/516f456510774149b0a9394b86dacc47` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:28.952298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] RBAC: Authorizing `identity:delete_project(project_id=516f456510774149b0a9394b86dacc47)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:28.956476 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:28.995177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe624-da7c-4b36-97f3-ccc4b6c66a37 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.002772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.005623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.006179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.006480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.009765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.014333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.063919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 872/1745] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:28 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:29.065063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.067408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.082358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516f456510774149b0a9394b86dacc47', 'request_id': 'req-b2b4bf09-d2b6-4afa-8dea-96276402614c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.100683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516f456510774149b0a9394b86dacc47', 'request_id': 'req-b2b4bf09-d2b6-4afa-8dea-96276402614c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.103176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.114954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516f456510774149b0a9394b86dacc47', 'request_id': 'req-b2b4bf09-d2b6-4afa-8dea-96276402614c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.137137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] The token cache is being invalidate because project 516f456510774149b0a9394b86dacc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:29.137427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.143650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.146263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 874/1746] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:28 2022] DELETE /identity/v3/projects/516f456510774149b0a9394b86dacc47 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:29.147057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.148588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.167662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a27a-4921-4d78-9b9a-245b1f6b2974 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.174204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.174528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.174872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.175144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] PATH_INFO: `/v3/projects/ee24e2f2cf094efb84a99d08f342e821` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.176480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee24e2f2cf094efb84a99d08f342e821)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.178571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.189341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.270642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee24e2f2cf094efb84a99d08f342e821', 'request_id': 'req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.275942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4bf09-d2b6-4afa-8dea-96276402614c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.280798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee24e2f2cf094efb84a99d08f342e821', 'request_id': 'req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.290426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee24e2f2cf094efb84a99d08f342e821', 'request_id': 'req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.310722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] The token cache is being invalidate because project ee24e2f2cf094efb84a99d08f342e821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:29.311069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.311886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.314437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 873/1747] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:29 2022] DELETE /identity/v3/projects/ee24e2f2cf094efb84a99d08f342e821 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:29.319914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.321679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.440465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d449-2a9a-4ca3-b833-9b56dad8fb07 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.452730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.453395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.453742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.453977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] PATH_INFO: `/v3/users/09d96bcec8cb47eabcc6910c65724248` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.459970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d96bcec8cb47eabcc6910c65724248)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.465072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.470562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.472877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.474416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.475262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.477554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.491134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.552662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 875/1748] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:29 2022] POST /identity/v3/users => generated 297 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:29.553294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.581755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.584753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d96bcec8cb47eabcc6910c65724248'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.603975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d96bcec8cb47eabcc6910c65724248'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.605612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d96bcec8cb47eabcc6910c65724248'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.606912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667d86-6249-4a63-8c1f-ac3f5090f228 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:29.612944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:29.614889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:29.615349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:29.615790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] PATH_INFO: `/v3/users/0254e63ce8224da5a1df5f9136a568d0` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:29.617548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0254e63ce8224da5a1df5f9136a568d0)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:29.619674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:29.662966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d96bcec8cb47eabcc6910c65724248'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.667355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d96bcec8cb47eabcc6910c65724248'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.722403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 874/1749] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:29 2022] DELETE /identity/v3/users/09d96bcec8cb47eabcc6910c65724248 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:29.726999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:29.728846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:29.776784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0254e63ce8224da5a1df5f9136a568d0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.795824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0254e63ce8224da5a1df5f9136a568d0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.810711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.840198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0254e63ce8224da5a1df5f9136a568d0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.844781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0254e63ce8224da5a1df5f9136a568d0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.891551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0254e63ce8224da5a1df5f9136a568d0'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:29.894205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:29.908834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 876/1750] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:29 2022] DELETE /identity/v3/users/0254e63ce8224da5a1df5f9136a568d0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:29.982352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b72528-9cdf-4555-8d24-b90cd1903c47 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.114309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.115064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.115346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.115564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.117229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.128997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.176421 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 875/1751] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:30.180647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.183340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.219117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37266d-47f7-4254-a944-481fcd24dadd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.238305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.238943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.245448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.247313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] PATH_INFO: `/v3/projects/0cf9c5266e3a489c81c10e50f04d5557/users/1c4e22bb20ea469eb110c825688c131f/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.316808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf9c5266e3a489c81c10e50f04d5557, user_id=1c4e22bb20ea469eb110c825688c131f, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.320689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.346793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 877/1752] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:30 2022] PUT /identity/v3/projects/0cf9c5266e3a489c81c10e50f04d5557/users/1c4e22bb20ea469eb110c825688c131f/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:30.349668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.365690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9045827-e0bf-4e46-8062-1d045de14109 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.483705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448dee0-0375-4d88-805d-639d9733f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.488072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448dee0-0375-4d88-805d-639d9733f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.488606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448dee0-0375-4d88-805d-639d9733f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.489066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448dee0-0375-4d88-805d-639d9733f7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.490082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448dee0-0375-4d88-805d-639d9733f7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.493423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448dee0-0375-4d88-805d-639d9733f7ad admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.519337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 876/1753] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:30.522598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.538033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbe336-5565-43c0-a853-39f441d141fa admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.552167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.553487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.553965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.554479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] PATH_INFO: `/v3/projects/0cf9c5266e3a489c81c10e50f04d5557/users/1c4e22bb20ea469eb110c825688c131f/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.563229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf9c5266e3a489c81c10e50f04d5557, user_id=1c4e22bb20ea469eb110c825688c131f, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:30.568656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:30.601445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 878/1754] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:30 2022] PUT /identity/v3/projects/0cf9c5266e3a489c81c10e50f04d5557/users/1c4e22bb20ea469eb110c825688c131f/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:30.612292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:30.613143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:30.613651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:30.664586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] MFA Rules not processed for user `1c4e22bb20ea469eb110c825688c131f`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:30.666195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.721058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:30.771234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 877/1755] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:30.789560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.792096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.963741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95462cee-eea6-4fa4-a2f7-8b06d877a093 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:30.969440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:30.971565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:30.997541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a485c-031e-406d-9c71-faed96f252c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:30.998518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a485c-031e-406d-9c71-faed96f252c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.001111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a485c-031e-406d-9c71-faed96f252c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.002329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a485c-031e-406d-9c71-faed96f252c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.051160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a485c-031e-406d-9c71-faed96f252c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.058967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a485c-031e-406d-9c71-faed96f252c5 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.124153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 879/1756] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:31.224049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25e9fe-8ca8-435a-bf9a-26a7b5568161 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.243430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.244512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.244792 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.245059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] PATH_INFO: `/v3/projects/a6879cde959b49e791c28060ab4d3a83` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.246903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6879cde959b49e791c28060ab4d3a83)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.249118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.356040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6879cde959b49e791c28060ab4d3a83', 'request_id': 'req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:31.370493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6879cde959b49e791c28060ab4d3a83', 'request_id': 'req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:31.411579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6879cde959b49e791c28060ab4d3a83', 'request_id': 'req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:31.439239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] The token cache is being invalidate because project a6879cde959b49e791c28060ab4d3a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:31.439618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:31.448992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ecca9917-e49a-40fb-8fb7-c1d9a3f20329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:31.451163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 878/1757] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:30 2022] DELETE /identity/v3/projects/a6879cde959b49e791c28060ab4d3a83 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:31.457510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.458298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.458772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.501879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:31.504947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:31.653634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 880/1758] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:31.665632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.666260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.666533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.706619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:31.708688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:31.721956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 879/1759] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:31.726425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.742119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb7050-d578-42e1-8245-6e962fddc5a5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.753627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.754789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.755167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.755546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.756324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:31.756797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.761977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.797374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 881/1760] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:31.801424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.834942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dc731-a7eb-498c-9e32-b265ad20191d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:31.855476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:31.861199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:31.861824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:31.864036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:31.864798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:31.867259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:31.935383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:31.938311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:31.938632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 880/1761] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:31 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:31.943563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.079135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:32.132697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d156b785-e185-4398-a93f-1e6b12eb4bee admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.135018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:32.145618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.146261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.146967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.146967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.147479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.151127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.168563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb596ecf-87fa-499e-a270-c816ad1c182f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.212062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 881/1762] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:31 2022] POST /identity/v3/users => generated 292 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:32.216636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.259432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe2580-1309-45ad-90c4-9a6a3853e20b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.279116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.282233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.286558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.287414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.288793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.292464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.312620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 882/1763] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:32.313895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.316358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.330909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a486ea-ae2f-4eb2-893b-85c79b3e3eb0 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.342417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.343662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.344639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.344864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] PATH_INFO: `/v3/projects/19b799f51daf439a861b1a787e253f9c` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.347524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b799f51daf439a861b1a787e253f9c)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.349495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.369068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4e22bb20ea469eb110c825688c131f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf9c5266e3a489c81c10e50f04d5557', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.369631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.369907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.370178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.370817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:32.371116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.373160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.391522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 882/1764] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:32.393107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.414239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e092bb-34cd-425b-8a54-967bdac43466 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.419865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb290c9-3f9c-4f16-9b3e-7a5fc1f044b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.420812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb290c9-3f9c-4f16-9b3e-7a5fc1f044b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.421583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb290c9-3f9c-4f16-9b3e-7a5fc1f044b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.422105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb290c9-3f9c-4f16-9b3e-7a5fc1f044b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.422869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb290c9-3f9c-4f16-9b3e-7a5fc1f044b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.424878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb290c9-3f9c-4f16-9b3e-7a5fc1f044b8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.440883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b799f51daf439a861b1a787e253f9c', 'request_id': 'req-bf4c1cd2-25ed-4f92-a338-86c07ce81861'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:32.447417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 883/1765] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:32.449928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974d3f1-538f-47d8-b9fb-5c1bfdc2a1a3 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.450396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974d3f1-538f-47d8-b9fb-5c1bfdc2a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.450729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974d3f1-538f-47d8-b9fb-5c1bfdc2a1a3 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.456830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 884/1766] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:22:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:32.457466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b799f51daf439a861b1a787e253f9c', 'request_id': 'req-bf4c1cd2-25ed-4f92-a338-86c07ce81861'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:32.460478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974d3f1-538f-47d8-b9fb-5c1bfdc2a1a3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.467403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b799f51daf439a861b1a787e253f9c', 'request_id': 'req-bf4c1cd2-25ed-4f92-a338-86c07ce81861'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:32.488846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] The token cache is being invalidate because project 19b799f51daf439a861b1a787e253f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:32.488846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:32.489837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:32.494999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 883/1767] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:32 2022] DELETE /identity/v3/projects/19b799f51daf439a861b1a787e253f9c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:32.494999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.510331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.551684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974d3f1-538f-47d8-b9fb-5c1bfdc2a1a3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.559002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe16059-5361-4847-b024-8e9f96d0acd3 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4e22bb20ea469eb110c825688c131f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf9c5266e3a489c81c10e50f04d5557', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.559630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16059-5361-4847-b024-8e9f96d0acd3 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.560194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16059-5361-4847-b024-8e9f96d0acd3 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.560546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe16059-5361-4847-b024-8e9f96d0acd3 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.561419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe16059-5361-4847-b024-8e9f96d0acd3 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.564250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe16059-5361-4847-b024-8e9f96d0acd3 tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.619608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c1cd2-25ed-4f92-a338-86c07ce81861 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.626707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332db04-0824-47ac-9d41-d32410c64a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.628037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332db04-0824-47ac-9d41-d32410c64a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.628037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332db04-0824-47ac-9d41-d32410c64a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.628569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332db04-0824-47ac-9d41-d32410c64a10 admin admin] PATH_INFO: `/v3/projects/bf61d9576f244a46b7aec0fce2d835f0/users/90703d745cf340c09b4d96b4ac290b55/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.639966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 885/1768] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:32 2022] POST /identity/v3/projects => generated 354 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:32.642479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.642977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.644297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.656426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332db04-0824-47ac-9d41-d32410c64a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf61d9576f244a46b7aec0fce2d835f0, user_id=90703d745cf340c09b4d96b4ac290b55, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.662925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332db04-0824-47ac-9d41-d32410c64a10 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.669311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:32.670867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.700776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 884/1769] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:32 2022] PUT /identity/v3/projects/bf61d9576f244a46b7aec0fce2d835f0/users/90703d745cf340c09b4d96b4ac290b55/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:32.703255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9cdb2-e25a-414c-9c39-1bfa1ded8ec1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.703743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9cdb2-e25a-414c-9c39-1bfa1ded8ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.704349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9cdb2-e25a-414c-9c39-1bfa1ded8ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.729893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e3f9cdb2-e25a-414c-9c39-1bfa1ded8ec1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:32.731829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e3f9cdb2-e25a-414c-9c39-1bfa1ded8ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.762248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:32.767997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:32.785133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 886/1770] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:32.786344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.788427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.833054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 885/1771] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:32.835386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.835672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.835941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.870694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] MFA Rules not processed for user `90703d745cf340c09b4d96b4ac290b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:32.871823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.872004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf3e68-7b0e-474b-9765-0f1ff045ef19 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:32.947290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4e22bb20ea469eb110c825688c131f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf9c5266e3a489c81c10e50f04d5557', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:32.947921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.948203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.948508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.949182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:32.949454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:32.951538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7fa8f-757f-42ff-b5d3-b9decd8b624a tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:32.960400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 886/1772] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:32.960400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:32.960400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.964759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 887/1773] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:32.966326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:32.966616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:32.966888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:32.988751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:32.989992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:32.998871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 888/1774] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:32.999751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.001195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.077147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757db6-fe36-4d75-ae2b-b16827431cda None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.081033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.081702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.082042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.082398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.086086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda43b-35d6-4511-a910-7dd99d0fc5c1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.092302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.093725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.093876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.094872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.095306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.095717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.104742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 889/1775] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:33.105844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.107704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.109524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.120658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf5fca-1e11-4e37-8a96-d388139be5c6 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.122009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 887/1776] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:33.123329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.125750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.126371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.126655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.126975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.127635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:33.128117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.131414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.134986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb23e5-d93b-4ed8-883a-4be6f1b4b23a service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.140168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c4e22bb20ea469eb110c825688c131f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf9c5266e3a489c81c10e50f04d5557', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.140935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.141272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.141608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] PATH_INFO: `/v3/projects/e9d92532b3974e4295320b2f9752cfc6` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.142804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9d92532b3974e4295320b2f9752cfc6)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.144880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.148280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 890/1777] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:33.151776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.167008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f7f99-bff3-499e-9a6f-d3a2aa38f426 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.172898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.174300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.174926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.175542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.177100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.178620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.208784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.213864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.222779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d92532b3974e4295320b2f9752cfc6', 'request_id': 'req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.228790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d92532b3974e4295320b2f9752cfc6', 'request_id': 'req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.230578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 891/1778] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:33.234978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.245828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d92532b3974e4295320b2f9752cfc6', 'request_id': 'req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.276982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] The token cache is being invalidate because project e9d92532b3974e4295320b2f9752cfc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:33.277277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.278382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.280869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 888/1779] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:33 2022] DELETE /identity/v3/projects/e9d92532b3974e4295320b2f9752cfc6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:33.321311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581c72-1cfe-4990-8cb5-293454fe85d6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.327821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.328512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.328793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.329034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.329672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.331835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.367237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 892/1780] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:33.371543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.374440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.473021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec7f14-cd51-498c-b3b7-4f3cde2db68e tempest-VolumeQuotaClassesTest-1317277435 tempest-VolumeQuotaClassesTest-1317277435-project-admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.478038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.478649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.479078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.479206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.480014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.481816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.492777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 889/1781] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:33.496752 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.509061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fddc76-a48a-4873-a070-7e479789eed0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.520144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.520834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.521560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.521845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.522496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.525118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.540407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 893/1782] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:33.543411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.555162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1ebe6-502e-4d89-bebc-cbf86e6686bf admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.564620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d08c0-d9fa-4895-a559-a082389a73bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.565307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d08c0-d9fa-4895-a559-a082389a73bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.565717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d08c0-d9fa-4895-a559-a082389a73bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.565964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d08c0-d9fa-4895-a559-a082389a73bb admin admin] PATH_INFO: `/v3/projects/8e77872050394babb0f98eae9f9c533f/users/a0587137e6974c50a24a0211a09964e1/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.593065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d08c0-d9fa-4895-a559-a082389a73bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e77872050394babb0f98eae9f9c533f, user_id=a0587137e6974c50a24a0211a09964e1, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.597664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d08c0-d9fa-4895-a559-a082389a73bb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.603875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.606076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.623362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a077a8-958c-495e-bb39-35760c90b9db admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.629918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 890/1783] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:33 2022] PUT /identity/v3/projects/8e77872050394babb0f98eae9f9c533f/users/a0587137e6974c50a24a0211a09964e1/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:33.642578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.642943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.643332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.673627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] MFA Rules not processed for user `a0587137e6974c50a24a0211a09964e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:33.674978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.693839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.694585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.694835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.695065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] PATH_INFO: `/v3/users/f1df58f362fd452293b15076f0c328a2` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.697942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1df58f362fd452293b15076f0c328a2)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.701211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.762822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 891/1784] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:33.767842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.779042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1df58f362fd452293b15076f0c328a2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.779912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59710c0d-8d0e-4f9c-ba59-4c38ca2b3528 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.785992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.786609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.786926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.787047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1df58f362fd452293b15076f0c328a2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.787263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.788078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.790330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.794483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1df58f362fd452293b15076f0c328a2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.795150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1df58f362fd452293b15076f0c328a2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.812969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1fc50354-865e-464c-a191-f2d0c5de39b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1df58f362fd452293b15076f0c328a2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:33.815210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.822984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 894/1785] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:33 2022] DELETE /identity/v3/users/f1df58f362fd452293b15076f0c328a2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:33.832552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 892/1786] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:33.834146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.836246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.836643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.837122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.837620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.854863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:33.874504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:33.876009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.938347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c43fe5-dbb8-43f9-842d-b705d3c26186 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.938901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 895/1787] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:33.943187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.943797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.944067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.944354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.945031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.947005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:33.948535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.949946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:33.969230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 893/1788] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:33 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:33.973307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:33.983177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e0df2-255b-4bc0-a4b6-9db97ca6cc9c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:33.987837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:33.988513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:33.988786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:33.989050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:33.989683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:33.991265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.001257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 894/1789] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:34.005661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.007225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911d80f-a784-4c1d-aede-0ebd417363c0 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.011297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.011934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.012185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.012485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.015385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ab747-4a8e-4c29-aecb-a3cd2ffe5954 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.020033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eb464-f809-4d9b-921d-b7e08d6e93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.020643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb464-f809-4d9b-921d-b7e08d6e93fb admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.020911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb464-f809-4d9b-921d-b7e08d6e93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.021172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eb464-f809-4d9b-921d-b7e08d6e93fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.021789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eb464-f809-4d9b-921d-b7e08d6e93fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.022529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.023545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eb464-f809-4d9b-921d-b7e08d6e93fb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.024102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.034305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 896/1790] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:34.034667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 895/1791] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:34.038852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.049052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4311-9590-4496-beb6-3e8b900ed4be service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.053918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.054653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.054925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.055193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] PATH_INFO: `/v3/projects/7832421ac4fb4f3d982f341547ef0660/users/d0ab143b0889443bb62eda93d2a2eac3/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.071590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7832421ac4fb4f3d982f341547ef0660, user_id=d0ab143b0889443bb62eda93d2a2eac3, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.074309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.088488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 897/1792] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:34 2022] PUT /identity/v3/projects/7832421ac4fb4f3d982f341547ef0660/users/d0ab143b0889443bb62eda93d2a2eac3/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:34.098915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.099200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.099475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.128324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] MFA Rules not processed for user `d0ab143b0889443bb62eda93d2a2eac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:34.129949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.202054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 896/1793] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:34.203248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.268549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd867d-50c9-4d47-b0b3-17847eacf837 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.273213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.273825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.274164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.274439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.275062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.277003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.305007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 898/1794] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:34 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:34.309574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.318633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.320660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.322460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985107f9-2f48-40fa-84b6-53edbb8aec7c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.325829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.394305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b11550-c1ec-44fa-bdb4-0f6c86c70579 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.398373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.398994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.399273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.399537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.400058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.400196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.400990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.401397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.401799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] PATH_INFO: `/v3/projects/1b0a9a4f7fc049db90ad091a90093180` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.402194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.403213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0a9a4f7fc049db90ad091a90093180)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.405555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.412501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.430221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 897/1795] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:34 2022] POST /identity/v3/users => generated 296 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:34.434184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.445078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd99d7-45e5-4681-b8ff-abdc96cd6b28 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.449151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.449750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.450023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.450355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.452957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.454551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.462141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0a9a4f7fc049db90ad091a90093180', 'request_id': 'req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.465086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 898/1796] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:34.469299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0a9a4f7fc049db90ad091a90093180', 'request_id': 'req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.469438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.480192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b6855-f0b1-45c0-a34f-e42ac82ee7bc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.485741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0a9a4f7fc049db90ad091a90093180', 'request_id': 'req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.516011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] The token cache is being invalidate because project 1b0a9a4f7fc049db90ad091a90093180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:34.516516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.517509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.522962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 899/1797] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:34 2022] DELETE /identity/v3/projects/1b0a9a4f7fc049db90ad091a90093180 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:34.525244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.526760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.546367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.547043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.547322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.547757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] PATH_INFO: `/v3/projects/dc1522ae76fe4e54a186ad773db1821c/users/f21af74655ad48ff97d6809352aeb2eb/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.564090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1522ae76fe4e54a186ad773db1821c, user_id=f21af74655ad48ff97d6809352aeb2eb, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.566416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.588037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 899/1798] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:34 2022] PUT /identity/v3/projects/dc1522ae76fe4e54a186ad773db1821c/users/f21af74655ad48ff97d6809352aeb2eb/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:34.592120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.594112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.597978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8aa5f-2439-4970-b53c-e93aa4637c8e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.638142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.658846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.659552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.659871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.660202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] PATH_INFO: `/v3/users/1c4e22bb20ea469eb110c825688c131f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.661371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4e22bb20ea469eb110c825688c131f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.663275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.704983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250699a-d37a-4283-bcd7-c13f89f2e4ef admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.709967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.710575 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.710849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.711113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.712011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.713504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.717787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4e22bb20ea469eb110c825688c131f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.724264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 900/1799] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:34.726368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4e22bb20ea469eb110c825688c131f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.728803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.734502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4e22bb20ea469eb110c825688c131f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.735278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4e22bb20ea469eb110c825688c131f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.738909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafbcc3-acaa-4b54-8984-f59800fa77ba admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.745553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:34.746487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.746876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.747298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] PATH_INFO: `/v3/projects/dc1522ae76fe4e54a186ad773db1821c/users/f21af74655ad48ff97d6809352aeb2eb/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.748018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-71760224-e10b-4363-adc8-c49dfdb7eebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4e22bb20ea469eb110c825688c131f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:34.750214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1522ae76fe4e54a186ad773db1821c, user_id=f21af74655ad48ff97d6809352aeb2eb, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:34.753364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 900/1800] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:34 2022] DELETE /identity/v3/users/1c4e22bb20ea469eb110c825688c131f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:34.754779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:34.775572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 901/1801] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:34 2022] PUT /identity/v3/projects/dc1522ae76fe4e54a186ad773db1821c/users/f21af74655ad48ff97d6809352aeb2eb/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:34.780864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:34.781315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:34.781657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:34.811019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] MFA Rules not processed for user `f21af74655ad48ff97d6809352aeb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:34.812586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.904998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 901/1802] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:34.918277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:34.920851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:34.982978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:34.994781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4696a7-c263-4b6f-9744-cd6c865b95ff admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:34.999445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.000276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.000574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.000843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.010710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.012143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.022340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 902/1803] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:35.066706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.068305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.080811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffd9e7-a5ba-49cf-a37c-a6c6145d890f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.084878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.085889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.085889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.086082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.087827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.133418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:35.165039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.167098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64beed70-4e0b-43d0-a2e5-2c1d5ea7f175 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.178848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 902/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:35.238328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.240272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.332855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567ca31-e893-40e7-990c-6405d5e517db service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.337303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.338205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.338483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.338748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] PATH_INFO: `/v3/projects/0cf9c5266e3a489c81c10e50f04d5557` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.340863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf9c5266e3a489c81c10e50f04d5557)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.343085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.394515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf9c5266e3a489c81c10e50f04d5557', 'request_id': 'req-9d90ff3c-888a-4be8-ba89-15e3b119036e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.400390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf9c5266e3a489c81c10e50f04d5557', 'request_id': 'req-9d90ff3c-888a-4be8-ba89-15e3b119036e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.406879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf9c5266e3a489c81c10e50f04d5557', 'request_id': 'req-9d90ff3c-888a-4be8-ba89-15e3b119036e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.421190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] The token cache is being invalidate because project 0cf9c5266e3a489c81c10e50f04d5557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:35.421530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.422339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9d90ff3c-888a-4be8-ba89-15e3b119036e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:35.424298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 903/1805] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:35 2022] DELETE /identity/v3/projects/0cf9c5266e3a489c81c10e50f04d5557 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:35.429741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.430026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.430299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.451765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:35.453289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.538256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 903/1806] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:35.547282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.547598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.548156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.573076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:35.574270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:35.582941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 904/1807] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:35.587583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.598648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccd33c-8cc4-4137-9833-bb3b2e9b6dec None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.603353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.603973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.604253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.604555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.605210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:35.605543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.607332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.618969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 904/1808] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:35.623950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.633909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f020f50-b7b8-4548-bbff-7bd4d3e3601b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.639073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.639684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.639956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.640220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.640874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.642793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.674974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 905/1809] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:35.679361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.691420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d09a8b-93f7-4d58-b6e7-1fa951be718e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.775566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.776246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.776605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.776964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.777649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.779739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.806088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 905/1810] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:35.807409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.818923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b77ca-08dc-40bd-9ed5-3c5fcb09707e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.824308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.825006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.825293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.825560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.826238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.828551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.842776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 906/1811] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:35.843604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.853636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4aa5c3-a67a-42f3-a3cb-3f5abe1ea368 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.858771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ac65c-f970-4044-9939-28e4bbd36894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.859514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac65c-f970-4044-9939-28e4bbd36894 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.859867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac65c-f970-4044-9939-28e4bbd36894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.860206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ac65c-f970-4044-9939-28e4bbd36894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.860993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac65c-f970-4044-9939-28e4bbd36894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.862717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ac65c-f970-4044-9939-28e4bbd36894 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.875188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 906/1812] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:35.879679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:35.901717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebdc4ef-c301-4b0b-ac06-9b08f151f8cc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:35.907162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:35.907860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.908135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.908425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] PATH_INFO: `/v3/projects/309913ce40fd4018a718ba2bbaf942cd/users/7241bce64fb243448e014c1b7045740f/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.924250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309913ce40fd4018a718ba2bbaf942cd, user_id=7241bce64fb243448e014c1b7045740f, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:35.927166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:35.943031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 907/1813] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:35 2022] PUT /identity/v3/projects/309913ce40fd4018a718ba2bbaf942cd/users/7241bce64fb243448e014c1b7045740f/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:35.954716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea94376-f825-4d03-ab84-c4184935224c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:35.955003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea94376-f825-4d03-ab84-c4184935224c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:35.955277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea94376-f825-4d03-ab84-c4184935224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:35.982685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fea94376-f825-4d03-ab84-c4184935224c None None] MFA Rules not processed for user `7241bce64fb243448e014c1b7045740f`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:35.983912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fea94376-f825-4d03-ab84-c4184935224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.022603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.055172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 907/1814] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:36.061665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.077028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.131800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af245524-5991-417b-ac63-4d5cfb10e869 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.137169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.137866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.138143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.138461 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.139073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.141150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.169516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 908/1815] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:36.173990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea94376-f825-4d03-ab84-c4184935224c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.185627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea94376-f825-4d03-ab84-c4184935224c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.249908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.250522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.250796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.251064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.251813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.253755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.279277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 908/1816] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:36.283190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.294176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee063c-2b78-4f23-b701-8606bdfeed89 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.299203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.299833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.300107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.300405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.301050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.302696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.316039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 909/1817] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:36.320415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.331349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfe287-00d0-4205-8b20-64cb4a5e9a17 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.336991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf833d0-4342-4118-8cc8-92ef2dbde755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.337590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf833d0-4342-4118-8cc8-92ef2dbde755 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.337856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf833d0-4342-4118-8cc8-92ef2dbde755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.338174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf833d0-4342-4118-8cc8-92ef2dbde755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.338815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf833d0-4342-4118-8cc8-92ef2dbde755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.340448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf833d0-4342-4118-8cc8-92ef2dbde755 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.364516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 909/1818] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:36.364670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.372322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be740aad-95dd-4089-ada3-0cf118118954 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.377198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.377865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.378613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.378613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] PATH_INFO: `/v3/projects/983992322c9749fd9223dde7f9f509b3/users/ab75f16e06a345408ac123d1e3ddca76/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.393497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983992322c9749fd9223dde7f9f509b3, user_id=ab75f16e06a345408ac123d1e3ddca76, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.396136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.413803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 910/1819] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:36 2022] PUT /identity/v3/projects/983992322c9749fd9223dde7f9f509b3/users/ab75f16e06a345408ac123d1e3ddca76/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:36.424608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.424890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.425314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.456981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] MFA Rules not processed for user `ab75f16e06a345408ac123d1e3ddca76`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:36.458866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:36.534563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 910/1820] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:36.539486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.605337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929ca6-4ebb-4627-96cc-ac340fafc488 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.609961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.610567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.610844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.611112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.611733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.613688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.641733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 911/1821] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:36.646155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.657325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91586b83-b819-411f-87a2-f2aaf6941a3c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.708934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.723162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.723767 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.724034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.724302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.724961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.726875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.752256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 911/1822] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:36 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:36.753458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.764871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e7202-fcd9-48e1-afcb-3e2e2c49c32a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.770685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.771285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.771664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.772099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.772774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.774418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.786491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 912/1823] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:36.790988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.801267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a541a-df95-49ce-ae07-68d00e4d09c2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.806277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.806916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.807190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.807456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] PATH_INFO: `/v3/projects/d481d825c6754865b706f108b0bfe6c1/users/7d200f9446c14d63af1bdc6de28dab65/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.832951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d481d825c6754865b706f108b0bfe6c1, user_id=7d200f9446c14d63af1bdc6de28dab65, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.837210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.854361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 912/1824] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:36 2022] PUT /identity/v3/projects/d481d825c6754865b706f108b0bfe6c1/users/7d200f9446c14d63af1bdc6de28dab65/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:36.859075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.869313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c936-01a3-498a-ad2e-cba1f7170769 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.905393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:36.932841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6c01f-064c-4f70-95aa-72884837d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.933779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c01f-064c-4f70-95aa-72884837d603 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.934191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c01f-064c-4f70-95aa-72884837d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.934629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6c01f-064c-4f70-95aa-72884837d603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.935422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6c01f-064c-4f70-95aa-72884837d603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.937199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6c01f-064c-4f70-95aa-72884837d603 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:36.953833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 913/1825] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:36.957633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:36.972368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c59a03-a6ef-4213-bf32-1f9d1838b031 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:36.978995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:36.980110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:36.980593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:36.981028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] PATH_INFO: `/v3/projects/d481d825c6754865b706f108b0bfe6c1/users/7d200f9446c14d63af1bdc6de28dab65/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:36.987995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d481d825c6754865b706f108b0bfe6c1, user_id=7d200f9446c14d63af1bdc6de28dab65, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:36.990669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.001640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 913/1826] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:36 2022] PUT /identity/v3/projects/d481d825c6754865b706f108b0bfe6c1/users/7d200f9446c14d63af1bdc6de28dab65/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:37.013148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.013423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.013687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.043114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] MFA Rules not processed for user `7d200f9446c14d63af1bdc6de28dab65`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:37.044573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.114231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 914/1827] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:37.125582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.127535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.185333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492f40c-a61f-4106-aa56-58c3d4b3a4c7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.189656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.190271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.190547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.190810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.201140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.202568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.212144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 914/1828] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:37.806277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:37.807870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:37.820240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74992892-56eb-4850-bcc8-e0c100fda083 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:37.824404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007269e8-06f0-4910-a584-7232a7223309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:37.825007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007269e8-06f0-4910-a584-7232a7223309 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:37.825542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007269e8-06f0-4910-a584-7232a7223309 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:37.825814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007269e8-06f0-4910-a584-7232a7223309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:37.889768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007269e8-06f0-4910-a584-7232a7223309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:37.891239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007269e8-06f0-4910-a584-7232a7223309 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:37.900482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 915/1829] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:47.207776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=49,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:47.896536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=74 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:49.819512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:49.821289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:49.909761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1daab-6fd1-4a56-b0b7-2e9fed40e7d3 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:49.915420 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:49.916464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:49.916842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:49.917567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] PATH_INFO: `/v3/users/a0587137e6974c50a24a0211a09964e1` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:49.918696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0587137e6974c50a24a0211a09964e1)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:49.921220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:50.034465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0587137e6974c50a24a0211a09964e1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.053193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0587137e6974c50a24a0211a09964e1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.071570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0587137e6974c50a24a0211a09964e1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.073010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0587137e6974c50a24a0211a09964e1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.095135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0587137e6974c50a24a0211a09964e1'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.108415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 915/1830] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:49 2022] DELETE /identity/v3/users/a0587137e6974c50a24a0211a09964e1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:50.108710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14686181-a782-48ee-bc61-6523c43043aa None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.108710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14686181-a782-48ee-bc61-6523c43043aa None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.108710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14686181-a782-48ee-bc61-6523c43043aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.156866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-14686181-a782-48ee-bc61-6523c43043aa None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:50.158272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-14686181-a782-48ee-bc61-6523c43043aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.286944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 916/1831] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:50.291534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:50.293032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.368449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56844e7b-a0c1-43bf-a0ad-0707662ee3b1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:50.372174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:50.372827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.373126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.373397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.386918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:50.388353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:50.398689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 916/1832] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:50.682354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14686181-a782-48ee-bc61-6523c43043aa None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:50.683973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-14686181-a782-48ee-bc61-6523c43043aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:50.698182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14686181-a782-48ee-bc61-6523c43043aa None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:50.703372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:50.703995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.704263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.705267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] PATH_INFO: `/v3/projects/8e77872050394babb0f98eae9f9c533f` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.706754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e77872050394babb0f98eae9f9c533f)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:50.708695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:50.757828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e77872050394babb0f98eae9f9c533f', 'request_id': 'req-1aabb873-bd58-4818-9f24-5f1edb399112'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.763144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e77872050394babb0f98eae9f9c533f', 'request_id': 'req-1aabb873-bd58-4818-9f24-5f1edb399112'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.769373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e77872050394babb0f98eae9f9c533f', 'request_id': 'req-1aabb873-bd58-4818-9f24-5f1edb399112'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.783134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] The token cache is being invalidate because project 8e77872050394babb0f98eae9f9c533f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:50.783441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.784052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.785568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 917/1833] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:50 2022] DELETE /identity/v3/projects/8e77872050394babb0f98eae9f9c533f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:50.789945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:50.801372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ac37-5df3-419d-b17a-0606ca413b10 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:50.821601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:50.861949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:50.862585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:50.863004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:50.863277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] PATH_INFO: `/v3/users/d0ab143b0889443bb62eda93d2a2eac3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:50.864410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ab143b0889443bb62eda93d2a2eac3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:50.866541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:50.916809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ab143b0889443bb62eda93d2a2eac3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.925689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ab143b0889443bb62eda93d2a2eac3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.932646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ab143b0889443bb62eda93d2a2eac3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.933342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ab143b0889443bb62eda93d2a2eac3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.946290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ebd83f3-6096-4831-9b93-daba5155c50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ab143b0889443bb62eda93d2a2eac3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:50.953108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 917/1834] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:50 2022] DELETE /identity/v3/users/d0ab143b0889443bb62eda93d2a2eac3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:51.292572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:51.294066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:51.321520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabb873-bd58-4818-9f24-5f1edb399112 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:51.349008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae436-059c-4c6e-8277-1551a0126000 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.349317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae436-059c-4c6e-8277-1551a0126000 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.349598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae436-059c-4c6e-8277-1551a0126000 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.351522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 918/1835] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:22:51.367282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.367997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.367997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.407375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:51.409426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:51.470192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:51.471319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.478238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.478384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] PATH_INFO: `/v3/projects/7832421ac4fb4f3d982f341547ef0660` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.479599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7832421ac4fb4f3d982f341547ef0660)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:51.481606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:51.528087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:51.553939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7832421ac4fb4f3d982f341547ef0660', 'request_id': 'req-d32b575f-acf3-4a19-b689-152562e070d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.562917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7832421ac4fb4f3d982f341547ef0660', 'request_id': 'req-d32b575f-acf3-4a19-b689-152562e070d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.572352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7832421ac4fb4f3d982f341547ef0660', 'request_id': 'req-d32b575f-acf3-4a19-b689-152562e070d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.579904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 919/1836] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:51.591901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:51.596821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:51.598945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] The token cache is being invalidate because project 7832421ac4fb4f3d982f341547ef0660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:51.599676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.600703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.602687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 918/1837] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:51 2022] DELETE /identity/v3/projects/7832421ac4fb4f3d982f341547ef0660 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:51.607207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:51.609137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:51.622401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef9d5b-4124-4d02-9901-b64cfc5c1a4e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:51.679336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:51.687486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b575f-acf3-4a19-b689-152562e070d0 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:51.699202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:51.699870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.700147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.700476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] PATH_INFO: `/v3/users/f21af74655ad48ff97d6809352aeb2eb` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.701839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21af74655ad48ff97d6809352aeb2eb)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:51.705041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:51.721807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:51.723360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.723644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.723919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] PATH_INFO: `/v3/users/90703d745cf340c09b4d96b4ac290b55` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.725209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] RBAC: Authorizing `identity:delete_user(user_id=90703d745cf340c09b4d96b4ac290b55)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:51.727311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:51.825342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21af74655ad48ff97d6809352aeb2eb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.837612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90703d745cf340c09b4d96b4ac290b55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.849921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21af74655ad48ff97d6809352aeb2eb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.851217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21af74655ad48ff97d6809352aeb2eb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.862595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90703d745cf340c09b4d96b4ac290b55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.883122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90703d745cf340c09b4d96b4ac290b55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.886266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90703d745cf340c09b4d96b4ac290b55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.901748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21af74655ad48ff97d6809352aeb2eb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.902530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-fa5cbde1-f6da-4ff5-8b7f-d3189a41aceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21af74655ad48ff97d6809352aeb2eb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.930442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90703d745cf340c09b4d96b4ac290b55'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:51.933413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 919/1838] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:51 2022] DELETE /identity/v3/users/f21af74655ad48ff97d6809352aeb2eb => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:51.949994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 920/1839] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:51 2022] DELETE /identity/v3/users/90703d745cf340c09b4d96b4ac290b55 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:51.961288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:51.961288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:51.961288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:51.983881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:51.985279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.021411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:52.071064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 920/1840] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:52.084201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.086574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.139733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.141476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.180369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64edf7-bfeb-4ce9-b9ae-9965edfe548e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:52.184878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:52.185567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.185909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.186442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.197097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:52.199969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:52.220758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 921/1841] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:52.239558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febec597-b68a-4fc8-8da9-35d25dc0d8d2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:52.245923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:52.246621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.246965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.247306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.249504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.265021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:52.267344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0442ec-37ba-4aa2-b414-0183d433feab service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:52.280502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 921/1842] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:52.535310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.537019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.558286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4b22f-96c1-4cc1-81b7-aa49d9cc8262 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:52.563659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:52.564370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.564744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.565079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] PATH_INFO: `/v3/projects/bf61d9576f244a46b7aec0fce2d835f0` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.566985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf61d9576f244a46b7aec0fce2d835f0)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:52.569383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:52.629217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf61d9576f244a46b7aec0fce2d835f0', 'request_id': 'req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.630491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:52.635935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf61d9576f244a46b7aec0fce2d835f0', 'request_id': 'req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.645323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf61d9576f244a46b7aec0fce2d835f0', 'request_id': 'req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.659469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] The token cache is being invalidate because project bf61d9576f244a46b7aec0fce2d835f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:52.659756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.660371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.662014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 922/1843] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:52 2022] DELETE /identity/v3/projects/bf61d9576f244a46b7aec0fce2d835f0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:52.667022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa693a-ea2f-46f5-b2c1-18f12f3f4348 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.667547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa693a-ea2f-46f5-b2c1-18f12f3f4348 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.667703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa693a-ea2f-46f5-b2c1-18f12f3f4348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.688303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-cafa693a-ea2f-46f5-b2c1-18f12f3f4348 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:52.690305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-cafa693a-ea2f-46f5-b2c1-18f12f3f4348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.742515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.744008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.765957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 922/1844] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:52.773928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.774268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.774593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.798462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:52.799984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:52.809927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 923/1845] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:52.814564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.827528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de63a8-203c-43f3-9d98-70b71b4df4ad None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:52.834482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:52.835178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.835523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.835795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.836595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:52.836898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:52.838546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:52.851802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 924/1846] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:52.853795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6ec3a-988a-4610-a89a-edce5fc7ccab admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:52.856114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.858844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:52.859590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.859861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.860300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] PATH_INFO: `/v3/projects/dc1522ae76fe4e54a186ad773db1821c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.861465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1522ae76fe4e54a186ad773db1821c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:52.863348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:52.866481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95749bd9-c653-454a-a2ae-65efd0c5c7d2 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:52.875086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:52.875958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.876407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.876827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.877616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:52.879978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:52.915339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 925/1847] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:52 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:52.916615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:52.916900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1522ae76fe4e54a186ad773db1821c', 'request_id': 'req-76557179-1c77-4946-9730-9b06fd7feeb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.922521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1522ae76fe4e54a186ad773db1821c', 'request_id': 'req-76557179-1c77-4946-9730-9b06fd7feeb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.929685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1522ae76fe4e54a186ad773db1821c', 'request_id': 'req-76557179-1c77-4946-9730-9b06fd7feeb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.938535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:52.947204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] The token cache is being invalidate because project dc1522ae76fe4e54a186ad773db1821c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:52.947533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.948158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-76557179-1c77-4946-9730-9b06fd7feeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:52.952598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 923/1848] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:52 2022] DELETE /identity/v3/projects/dc1522ae76fe4e54a186ad773db1821c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:52.962569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a998-9fec-449c-bfad-82f038fcd5d7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:52.962569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a998-9fec-449c-bfad-82f038fcd5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:52.962569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a998-9fec-449c-bfad-82f038fcd5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:52.991114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c842a998-9fec-449c-bfad-82f038fcd5d7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:52.992782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c842a998-9fec-449c-bfad-82f038fcd5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.009625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 924/1849] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:53.010016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183caaae-77eb-4b70-ae10-a0883dc7801b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.010016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.010563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.010934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.011125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.011377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.011496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.011656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.012331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.014648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.038270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:53.039771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.047125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 926/1850] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:52 2022] POST /identity/v3/users => generated 281 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:53.049263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 925/1851] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:53.051377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.052937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.054687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.067198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c1f5-6edb-4fc2-97c0-29a09e423359 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.068251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71338778-16f0-49a3-aab6-7acee4f5bcf6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.072508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.073210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.073491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.073803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.074445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.076038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.087275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.088643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.088929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.089348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.090020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:53.090320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.092250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.093488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 926/1852] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:53.097561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.107327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 927/1853] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:53.110045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55831614-c687-4095-ac80-0e3ca4b6939a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.112590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.115026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.115626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.115901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.116167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.116862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.118710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.123998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62574f2-5be0-4bad-989c-a7ec7a9520ed admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.131982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.132200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.132859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 927/1854] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:53.133525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.133525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.134576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.137273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.148645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.175004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46888872-da37-4211-93d2-917ab1be190e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.183730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 928/1855] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:53 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:53.184016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bde0a-7a37-4525-896a-db5373907316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.188587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.199997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bde0a-7a37-4525-896a-db5373907316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.200285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bde0a-7a37-4525-896a-db5373907316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.200617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bde0a-7a37-4525-896a-db5373907316 admin admin] PATH_INFO: `/v3/projects/abfb9f7f02544a468d5463a1cecc896b/users/85ac7ae91f3f456596f505f710ea5df7/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.241371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bde0a-7a37-4525-896a-db5373907316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfb9f7f02544a468d5463a1cecc896b, user_id=85ac7ae91f3f456596f505f710ea5df7, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.247548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bde0a-7a37-4525-896a-db5373907316 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.277242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 928/1856] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:53 2022] PUT /identity/v3/projects/abfb9f7f02544a468d5463a1cecc896b/users/85ac7ae91f3f456596f505f710ea5df7/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:53.287431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.287930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.288559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.310221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:53.318429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bea4d-9c51-4666-9b9f-94f5b973db6d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.321880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] MFA Rules not processed for user `85ac7ae91f3f456596f505f710ea5df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:53.323304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.411960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.414839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.422810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.423159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.423893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.426307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.488295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 929/1857] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:53 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:53.489234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.490953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.499895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 929/1858] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:53.500988 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.513074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:53.539135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1a644-392c-4214-85a6-fa91576abc0a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.545442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.546211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.546566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.546903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.547622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.549357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.584573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 930/1859] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:53.585549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.587365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.593267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3028c-aea5-43cb-bf23-80ef5eebcd20 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.596943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.597564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.597834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.598098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.599848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.601574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8ed16-1f15-43ab-baab-58193ebb3bad admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.609148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.610114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.610459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.610787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.622060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.623682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.636616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 931/1860] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:53.637329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.656585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee61ca-67b7-477d-9786-e2c802a10ff4 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.661356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.662113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.662376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.662645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.663277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.664897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.675350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 932/1861] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:53.676148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.677661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.679319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.685603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf9d82-870e-404f-b87a-f64fa51c0750 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.689129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 930/1862] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:53.689968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.691582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.692352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.692753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.693125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] PATH_INFO: `/v3/users/85ac7ae91f3f456596f505f710ea5df7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.694406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85ac7ae91f3f456596f505f710ea5df7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.696598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.701252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795efa5-db5d-402d-a43a-f05ada313df7 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:53.707103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5ecb8-5cb2-4faa-b608-c1d4dcc651ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:53.707849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ecb8-5cb2-4faa-b608-c1d4dcc651ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.708186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ecb8-5cb2-4faa-b608-c1d4dcc651ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.708681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5ecb8-5cb2-4faa-b608-c1d4dcc651ed admin admin] PATH_INFO: `/v3/projects/5ade54d2caa24115910f290970168565/users/8c7c472469f442b0beceac2acc6b98e9/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.724677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5ecb8-5cb2-4faa-b608-c1d4dcc651ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ade54d2caa24115910f290970168565, user_id=8c7c472469f442b0beceac2acc6b98e9, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:53.727412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5ecb8-5cb2-4faa-b608-c1d4dcc651ed admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:53.743571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 931/1863] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:53 2022] PUT /identity/v3/projects/5ade54d2caa24115910f290970168565/users/8c7c472469f442b0beceac2acc6b98e9/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:53.755255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.755486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.755737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.764118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85ac7ae91f3f456596f505f710ea5df7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:53.774422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85ac7ae91f3f456596f505f710ea5df7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:53.783618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85ac7ae91f3f456596f505f710ea5df7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:53.784399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85ac7ae91f3f456596f505f710ea5df7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:53.789360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] MFA Rules not processed for user `8c7c472469f442b0beceac2acc6b98e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:53.790522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.798501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a616d4dd-3859-45c1-bc25-d3fbe3d61582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85ac7ae91f3f456596f505f710ea5df7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:53.805807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 933/1864] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:53 2022] DELETE /identity/v3/users/85ac7ae91f3f456596f505f710ea5df7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:53.810023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:53.810862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:53.810862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:53.833776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:53.835825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.877481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 932/1865] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:53.896047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:53.909896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.914448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.942735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 934/1866] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:53.952785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:53.954058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:53.957237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:54.006518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c99b4-6926-4343-bccb-0d60ba7ff012 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.071942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60a0f9-55bd-4911-8817-281f5a05fce7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.084759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.085386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.085651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.085910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.102340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:54.103619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:54.111156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246bb88-4034-4793-b6aa-3a54cf1df96c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.111779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bb88-4034-4793-b6aa-3a54cf1df96c service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.112049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bb88-4034-4793-b6aa-3a54cf1df96c service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.112319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246bb88-4034-4793-b6aa-3a54cf1df96c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.120962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 935/1867] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:54.206781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246bb88-4034-4793-b6aa-3a54cf1df96c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:54.208241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246bb88-4034-4793-b6aa-3a54cf1df96c service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:54.218663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 933/1868] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:54.241152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:54.242790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:54.259536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07dcf-1e8c-4b76-9a46-859b0a21dd35 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.266797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.267571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.267924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.268247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] PATH_INFO: `/v3/users/8c7c472469f442b0beceac2acc6b98e9` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.269505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7c472469f442b0beceac2acc6b98e9)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:54.271486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:54.339481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7c472469f442b0beceac2acc6b98e9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.355492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7c472469f442b0beceac2acc6b98e9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.365173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7c472469f442b0beceac2acc6b98e9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.366542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7c472469f442b0beceac2acc6b98e9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.383398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7c472469f442b0beceac2acc6b98e9'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.392320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 936/1869] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:54 2022] DELETE /identity/v3/users/8c7c472469f442b0beceac2acc6b98e9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:54.397121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.397402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.397684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.418548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:54.420150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:54.452174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:54.453859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:54.513191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 934/1870] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:54.524859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:54.528078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:54.534637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:54.555819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83934e-72fd-4320-b4af-1929853eb135 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.569659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.572411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.572411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.572411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] PATH_INFO: `/v3/projects/abfb9f7f02544a468d5463a1cecc896b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.574186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfb9f7f02544a468d5463a1cecc896b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:54.578220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:54.595178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:54.625061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77103781-8b7b-4cc6-a1f4-53f658580ab7 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.633288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622b1d7-3b19-46b5-8bd0-3e3d4d137ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.633983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b1d7-3b19-46b5-8bd0-3e3d4d137ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.634266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b1d7-3b19-46b5-8bd0-3e3d4d137ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.634525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622b1d7-3b19-46b5-8bd0-3e3d4d137ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.657127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b1d7-3b19-46b5-8bd0-3e3d4d137ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:54.660962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622b1d7-3b19-46b5-8bd0-3e3d4d137ad6 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:54.686010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfb9f7f02544a468d5463a1cecc896b', 'request_id': 'req-52959f97-6000-42d7-99ab-f1d753c0ce4b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.696597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 935/1871] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:54.701947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfb9f7f02544a468d5463a1cecc896b', 'request_id': 'req-52959f97-6000-42d7-99ab-f1d753c0ce4b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.711372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfb9f7f02544a468d5463a1cecc896b', 'request_id': 'req-52959f97-6000-42d7-99ab-f1d753c0ce4b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.745830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] The token cache is being invalidate because project abfb9f7f02544a468d5463a1cecc896b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:54.746348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.747083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52959f97-6000-42d7-99ab-f1d753c0ce4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:54.749556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 937/1872] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:54 2022] DELETE /identity/v3/projects/abfb9f7f02544a468d5463a1cecc896b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:54.754682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.754963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.755241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.783017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:54.784888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:54.877501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 936/1873] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:54.893943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.894841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.894841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.919439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:54.920930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:54.930199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 938/1874] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:54.934422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:54.947087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779e9ea-d2dc-4e0e-bb88-96106b256e7c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.955163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.956777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:54.956777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:54.956777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:54.957173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:54.957538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:54.960165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:54.976441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 937/1875] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:54.978795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:54.989160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811a6e-5872-4b3c-9101-194d1a56299b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:54.998999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:54.999694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.000037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.000477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.001111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.003320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.038796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 939/1876] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:54 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:55.042983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.053295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b4a44-be56-4f43-91f2-651e8d1877eb admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.113788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.114447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.114716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.114978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.115604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.117720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.145113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 938/1877] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:55.146937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.158180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db748-06d9-49b6-a4ce-b9fe286ca58f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.164588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.164588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.164588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.167180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.169310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:55.174097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.174849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.181579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.184337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8134c-f5b7-4b72-8cdb-e61a7bf739c4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.192743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.193402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.193761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.194039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] PATH_INFO: `/v3/projects/5ade54d2caa24115910f290970168565` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.195165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ade54d2caa24115910f290970168565)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.197156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.219302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 940/1878] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:55.227078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.260207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea415f4-956e-431e-ba83-de0e93b52350 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.269828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ade54d2caa24115910f290970168565', 'request_id': 'req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:55.274601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:55.277190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ade54d2caa24115910f290970168565', 'request_id': 'req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:55.286953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ade54d2caa24115910f290970168565', 'request_id': 'req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:55.310891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] The token cache is being invalidate because project 5ade54d2caa24115910f290970168565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:55.311254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:55.311953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2b1dbeaa-1107-40a1-942e-654fb0e65a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:55.317508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 939/1879] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:55 2022] DELETE /identity/v3/projects/5ade54d2caa24115910f290970168565 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:55.322220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c44e-df58-43f4-b4be-3cd5d55f869a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.322808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c44e-df58-43f4-b4be-3cd5d55f869a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.323466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c44e-df58-43f4-b4be-3cd5d55f869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.341733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.342782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.342916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.343098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.343878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.346741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.351771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-8766c44e-df58-43f4-b4be-3cd5d55f869a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:55.353672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8766c44e-df58-43f4-b4be-3cd5d55f869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:55.360525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 941/1880] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:55.364522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.372247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:55.374750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 940/1881] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:55.377285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.377721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.378171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.387950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92d8a5-4fa6-44a8-aa41-3a643943b168 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.393137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3986939-92d9-4d3e-a6f2-d87fe6f0b093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.393883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986939-92d9-4d3e-a6f2-d87fe6f0b093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.394219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986939-92d9-4d3e-a6f2-d87fe6f0b093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.394685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3986939-92d9-4d3e-a6f2-d87fe6f0b093 admin admin] PATH_INFO: `/v3/projects/2508a6cf71d542659f881bdec5b429eb/users/929f45f00fbc40dc9a0897b5c8b49394/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.402798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:55.404350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:55.413828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986939-92d9-4d3e-a6f2-d87fe6f0b093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2508a6cf71d542659f881bdec5b429eb, user_id=929f45f00fbc40dc9a0897b5c8b49394, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.415373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 941/1882] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:55.418681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3986939-92d9-4d3e-a6f2-d87fe6f0b093 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.419881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.431756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513dd883-e131-48d7-86e1-a12ca2deafe4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.441232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 942/1883] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:55 2022] PUT /identity/v3/projects/2508a6cf71d542659f881bdec5b429eb/users/929f45f00fbc40dc9a0897b5c8b49394/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:55.454299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.454654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.455012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.498841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:55.501145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] MFA Rules not processed for user `929f45f00fbc40dc9a0897b5c8b49394`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:55.503251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:55.537029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.537646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.537915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.538176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.538818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:55.539116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.540735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.552333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 942/1884] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:55.557220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.568486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d740009-8aa4-4405-bb5a-9302f2411b84 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.573186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.573791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.574060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.574318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.574958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.576957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.585423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 943/1885] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:55.589827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.601084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6db43-eb80-44e4-8433-b69b34fb71b3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.606090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.606690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.607078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.607381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.611265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 943/1886] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:55.611395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.611395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.612220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.644037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 944/1887] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:55.645081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.683230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b71e8-408c-408d-9ff3-48630613d58f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.710389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ad7fa-504a-4367-8a71-9b03a1398b53 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.715358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.715969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.716249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.716559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.717194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.719171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.728195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:55.741249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 945/1888] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:55.742716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.743365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.744014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.745204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.745600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.746833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.749689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.756367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4187d-e31b-47d7-b558-0341e3b12860 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.761623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.762224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.762500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.762821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.763615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.765450 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.775731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 944/1889] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:55 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:55.776115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 946/1890] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:55.776958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.780761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.786474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec093d36-92fb-40ba-8ef8-2eecbc45b50d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.791302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.791895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.792168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.792278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff981fc-721e-469d-8dc3-71db5c4af8cf admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.794036 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.794695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.796479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.800708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.801530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.801923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.802202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] PATH_INFO: `/v3/projects/50098eba78034c61bafebd9e5404d04b/users/88f23d919153495fb38b7c104ab4742e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.807167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 945/1891] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:55.811417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.819158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50098eba78034c61bafebd9e5404d04b, user_id=88f23d919153495fb38b7c104ab4742e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.822051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.822779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f97bf-fd5f-4a9e-b6e8-31ce97bbbc2e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.828409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.829426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.829426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.829657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.830136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.831850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.837828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 947/1892] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:55 2022] PUT /identity/v3/projects/50098eba78034c61bafebd9e5404d04b/users/88f23d919153495fb38b7c104ab4742e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:55.841418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.847394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 946/1893] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:22:55.848438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.860997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77695a-5829-45b7-bdf6-1f2c6c4c63c3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.899781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:55.929908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12863280-5047-4dee-a9bf-8573b16b5ed3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.939237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.940003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.940396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.940806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.941545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.943230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.943344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36220a-106e-460d-a134-075a8573effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.943922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36220a-106e-460d-a134-075a8573effd admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.944333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36220a-106e-460d-a134-075a8573effd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.944641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36220a-106e-460d-a134-075a8573effd admin admin] PATH_INFO: `/v3/projects/7d5b5b0983a1413b93b48e0a66b93cbd/users/efacc4fe861a43f58acfeccd507e65d5/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:55.957471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 948/1894] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:55.961394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:55.967138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36220a-106e-460d-a134-075a8573effd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5b5b0983a1413b93b48e0a66b93cbd, user_id=efacc4fe861a43f58acfeccd507e65d5, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:55.973783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a36220a-106e-460d-a134-075a8573effd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:55.979570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab238c0-a8aa-4313-83dd-62d99acaf7ac admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:55.990182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78946d76-45c5-4be3-9fe2-e1f637054608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:55.992804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946d76-45c5-4be3-9fe2-e1f637054608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:55.993088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946d76-45c5-4be3-9fe2-e1f637054608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:55.993364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946d76-45c5-4be3-9fe2-e1f637054608 admin admin] PATH_INFO: `/v3/projects/50098eba78034c61bafebd9e5404d04b/users/88f23d919153495fb38b7c104ab4742e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.005309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 947/1895] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:55 2022] PUT /identity/v3/projects/7d5b5b0983a1413b93b48e0a66b93cbd/users/efacc4fe861a43f58acfeccd507e65d5/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:56.005557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78946d76-45c5-4be3-9fe2-e1f637054608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50098eba78034c61bafebd9e5404d04b, user_id=88f23d919153495fb38b7c104ab4742e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.005557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78946d76-45c5-4be3-9fe2-e1f637054608 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.018911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.019553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.020126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.030330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 949/1896] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:55 2022] PUT /identity/v3/projects/50098eba78034c61bafebd9e5404d04b/users/88f23d919153495fb38b7c104ab4742e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:56.034835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.035056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.035331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.055464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] MFA Rules not processed for user `efacc4fe861a43f58acfeccd507e65d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:56.057126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.067499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] MFA Rules not processed for user `88f23d919153495fb38b7c104ab4742e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:56.068854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.159733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 950/1897] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:56.166488 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 948/1898] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:56.171713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.171920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.173253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.217790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.254581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67853ca-7ad5-4df7-9227-4120d9c7d5b9 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.254888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f86cd8-d1cd-41b7-aa92-bcfb678f8e8f None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.258731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.259346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.259516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.259642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.259877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.260099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.260440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.260665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.261282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.263172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.301715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 951/1899] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:56.302635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.324155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.325760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.337453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.338246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 949/1900] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:22:56.375413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541fb9b-f7ad-4549-adc4-cc42de23d056 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.383280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.384047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.384438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.384782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.385749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.387793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.414514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 952/1901] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:56.418742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.430636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbb98c-2db9-4764-8baa-68f4a2ceb3d8 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.435636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.436295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.436611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.436882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.437529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.439187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.450761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 950/1902] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:56.454977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.456772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.458417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.466226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab2016-4988-419e-9762-2b5ca872a788 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.471154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.471500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8af068-4383-479a-b59f-7eb8914803ce admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.471755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.472038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.472310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.472995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.474604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.475959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.476764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.477171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.477439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] PATH_INFO: `/v3/users/7241bce64fb243448e014c1b7045740f` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.478551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7241bce64fb243448e014c1b7045740f)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.480500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.487281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 953/1903] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:56.491467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.508017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f203c-64b7-4945-a2a1-8d994051e3c8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.514216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96da7a7-d830-4302-b1c5-021bd521eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.515980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96da7a7-d830-4302-b1c5-021bd521eb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.516472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96da7a7-d830-4302-b1c5-021bd521eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.516804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96da7a7-d830-4302-b1c5-021bd521eb34 admin admin] PATH_INFO: `/v3/projects/c72a1e392b064555b8e6cc8dc97df0ff/users/f91a364b55e4484f8ae82b0a0eb0b584/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.539604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96da7a7-d830-4302-b1c5-021bd521eb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c72a1e392b064555b8e6cc8dc97df0ff, user_id=f91a364b55e4484f8ae82b0a0eb0b584, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.543379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96da7a7-d830-4302-b1c5-021bd521eb34 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.572566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 954/1904] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:56 2022] PUT /identity/v3/projects/c72a1e392b064555b8e6cc8dc97df0ff/users/f91a364b55e4484f8ae82b0a0eb0b584/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:56.579095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.579454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.579790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.588888 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7241bce64fb243448e014c1b7045740f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.601139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7241bce64fb243448e014c1b7045740f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.601991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7241bce64fb243448e014c1b7045740f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.613481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] MFA Rules not processed for user `f91a364b55e4484f8ae82b0a0eb0b584`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:56.614842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.621196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7241bce64fb243448e014c1b7045740f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.622038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-77939cae-49e1-44d8-ba26-2c67491e180b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7241bce64fb243448e014c1b7045740f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:56.642801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 951/1905] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:56 2022] DELETE /identity/v3/users/7241bce64fb243448e014c1b7045740f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:56.647867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.648153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.648542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.685854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:56.688340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.724231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 955/1906] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:56.728360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.731280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.761937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.792238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 952/1907] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:56.804507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.806409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:56.849615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83c22-174e-4f5b-a1f2-b215269911f3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.854329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.854977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.855263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.855630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.856304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.858312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.880537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:56.881767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350e749-80c9-43ac-bd16-369288ed7e98 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.885544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.886487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.886944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.887327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.895147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 956/1908] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:56.899124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:56.904022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.906058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.915966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 953/1909] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:56.960547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441b13-8b09-49cc-9cb1-1cea6fecca5d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:56.965726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:56.966346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:56.966699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:56.966906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:56.967716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:56.969763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:56.996274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 957/1910] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:56 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:56.997657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.007877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693697dc-f3b6-4e5b-8b9f-47844a0300dd service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.012878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.013661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.014105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.014413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.015154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.016968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.030547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 954/1911] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:57.037441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.049880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e870-b0d4-410a-9e1a-41edcd3eb1ae admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.056605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.057279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.057559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.057833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] PATH_INFO: `/v3/projects/5d92a4f1fc7d48cc916c1c87b269f886/users/93f3c90c93bd48659ae27639aaa3290d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.094463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d92a4f1fc7d48cc916c1c87b269f886, user_id=93f3c90c93bd48659ae27639aaa3290d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.097807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.113570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 958/1912] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:57 2022] PUT /identity/v3/projects/5d92a4f1fc7d48cc916c1c87b269f886/users/93f3c90c93bd48659ae27639aaa3290d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:57.117491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.128458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5feb611-3798-4e28-833b-27e17da12a3c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.212158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.214211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.214476 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.216534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.217186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.217625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.218648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.221278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.227421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a741-ff31-4e0b-a490-f7e6b7bf2e86 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.233127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 955/1913] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:57.237047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.242345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.242955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.243177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.243433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] PATH_INFO: `/v3/projects/309913ce40fd4018a718ba2bbaf942cd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.245014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309913ce40fd4018a718ba2bbaf942cd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.246945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.250863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6fe52-d7d8-43e1-843e-93348f08116f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.259564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209174-6f41-4029-839c-7783d8092926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.260491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209174-6f41-4029-839c-7783d8092926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.260767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209174-6f41-4029-839c-7783d8092926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.261384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209174-6f41-4029-839c-7783d8092926 admin admin] PATH_INFO: `/v3/projects/5d92a4f1fc7d48cc916c1c87b269f886/users/93f3c90c93bd48659ae27639aaa3290d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.263358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209174-6f41-4029-839c-7783d8092926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d92a4f1fc7d48cc916c1c87b269f886, user_id=93f3c90c93bd48659ae27639aaa3290d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.266367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209174-6f41-4029-839c-7783d8092926 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.278133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 956/1914] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:57 2022] PUT /identity/v3/projects/5d92a4f1fc7d48cc916c1c87b269f886/users/93f3c90c93bd48659ae27639aaa3290d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:57.289828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.290128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.290457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.313517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309913ce40fd4018a718ba2bbaf942cd', 'request_id': 'req-769de338-6dc3-4560-a0ff-2e92460e7354'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.319617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309913ce40fd4018a718ba2bbaf942cd', 'request_id': 'req-769de338-6dc3-4560-a0ff-2e92460e7354'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.322563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] MFA Rules not processed for user `93f3c90c93bd48659ae27639aaa3290d`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:57.323759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.326142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309913ce40fd4018a718ba2bbaf942cd', 'request_id': 'req-769de338-6dc3-4560-a0ff-2e92460e7354'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.342677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] The token cache is being invalidate because project 309913ce40fd4018a718ba2bbaf942cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:57.342677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.343101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.347687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 959/1915] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:57 2022] DELETE /identity/v3/projects/309913ce40fd4018a718ba2bbaf942cd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:57.348859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.350225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.381249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:57.405273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:57.419329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 957/1916] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:22:57.422125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769de338-6dc3-4560-a0ff-2e92460e7354 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.427733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.428471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.428810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.429147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] PATH_INFO: `/v3/users/ab75f16e06a345408ac123d1e3ddca76` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.430333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab75f16e06a345408ac123d1e3ddca76)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.431748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.432345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.433734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.493713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab75f16e06a345408ac123d1e3ddca76'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.502490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc99419-b009-471f-8200-1fdc49e9415f None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.502881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab75f16e06a345408ac123d1e3ddca76'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.508468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.509097 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.509707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.509707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.511457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.511573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab75f16e06a345408ac123d1e3ddca76'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.512210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab75f16e06a345408ac123d1e3ddca76'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.526963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab75f16e06a345408ac123d1e3ddca76'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:57.535220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 960/1917] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:57 2022] DELETE /identity/v3/users/ab75f16e06a345408ac123d1e3ddca76 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:57.573507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.574989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:57.584712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 958/1918] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:22:57.828908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:57.830461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:57.962919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dd3a6-105b-4729-808b-1b33b747caa2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:57.974304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:57.975039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:57.975376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:57.975722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] PATH_INFO: `/v3/projects/983992322c9749fd9223dde7f9f509b3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:57.977015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983992322c9749fd9223dde7f9f509b3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:57.979127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.032149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983992322c9749fd9223dde7f9f509b3', 'request_id': 'req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.037782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983992322c9749fd9223dde7f9f509b3', 'request_id': 'req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.044200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983992322c9749fd9223dde7f9f509b3', 'request_id': 'req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.048002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:58.068871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] The token cache is being invalidate because project 983992322c9749fd9223dde7f9f509b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:58.068871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.068871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.070839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 961/1919] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:57 2022] DELETE /identity/v3/projects/983992322c9749fd9223dde7f9f509b3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:58.074948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.086479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a753c-9d11-4bb5-8116-1e8c41c1c431 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.148094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.148687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.148984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.149302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] PATH_INFO: `/v3/users/7d200f9446c14d63af1bdc6de28dab65` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.150549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d200f9446c14d63af1bdc6de28dab65)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.152590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.197709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:58.203733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d200f9446c14d63af1bdc6de28dab65'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.215282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d200f9446c14d63af1bdc6de28dab65'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.215983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d200f9446c14d63af1bdc6de28dab65'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.228340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d200f9446c14d63af1bdc6de28dab65'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.229039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3e902b63-39b4-4327-89ad-160ba9671093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d200f9446c14d63af1bdc6de28dab65'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.242419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 959/1920] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:22:58 2022] DELETE /identity/v3/users/7d200f9446c14d63af1bdc6de28dab65 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:22:58.522927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.524820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.553153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13f83-5fc6-4d01-bbe3-e4d140697c07 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.614206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.614958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.615231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.615493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] PATH_INFO: `/v3/projects/d481d825c6754865b706f108b0bfe6c1` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.616624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d481d825c6754865b706f108b0bfe6c1)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.618506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.670303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd481d825c6754865b706f108b0bfe6c1', 'request_id': 'req-afdc16d1-6782-4125-9fef-b032b1f26c46'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.676705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd481d825c6754865b706f108b0bfe6c1', 'request_id': 'req-afdc16d1-6782-4125-9fef-b032b1f26c46'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.683106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd481d825c6754865b706f108b0bfe6c1', 'request_id': 'req-afdc16d1-6782-4125-9fef-b032b1f26c46'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.699402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] The token cache is being invalidate because project d481d825c6754865b706f108b0bfe6c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:22:58.699720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.700504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-afdc16d1-6782-4125-9fef-b032b1f26c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:22:58.702387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 962/1921] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:22:58 2022] DELETE /identity/v3/projects/d481d825c6754865b706f108b0bfe6c1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:58.708650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.708938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.709203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.729067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:58.730278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.796146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 960/1922] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:58.804354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.804676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.804949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.824965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:58.826190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:58.834584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 963/1923] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:58.839099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.849237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45225-96ec-49ea-947b-b8d0999c65fb None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.853869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.854494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.854772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.855037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.855693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:22:58.855995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.857657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.870248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 961/1924] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:22:58.874932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.891454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419b731-4f89-47cc-9bf9-6751f3244ad1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:58.897013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:58.897637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:58.897909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:58.898174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:58.898801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:58.900738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:58.933141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 964/1925] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:58 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:58.937406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:58.948324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ca551-a0fa-497b-aec7-fd945e90e7ae admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.020519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.021386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.021663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.022035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.022649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.025127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.059824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 962/1926] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:58 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:59.061443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.072731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98d64e-2087-44a3-9a65-66d930285aad admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.078226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.078859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.079134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.079407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.080054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.081739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.093217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 965/1927] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:59.098416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.115350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943cb9-167f-4099-a2da-e394c9d88647 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.119876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d454fd29-a953-4122-ae93-c9c835987fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.120643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454fd29-a953-4122-ae93-c9c835987fed admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.120989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454fd29-a953-4122-ae93-c9c835987fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.121175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d454fd29-a953-4122-ae93-c9c835987fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.121842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454fd29-a953-4122-ae93-c9c835987fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.123501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d454fd29-a953-4122-ae93-c9c835987fed admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.135204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 963/1928] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:59.140612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.150100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63a68a-1679-490e-a3f4-00c23b1ce381 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.154885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.155602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.155943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.156278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] PATH_INFO: `/v3/projects/21d1bd995f874b85ab80a25fae8ff8d8/users/fa457d51c2414498b187e95731ecf22b/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.172053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d1bd995f874b85ab80a25fae8ff8d8, user_id=fa457d51c2414498b187e95731ecf22b, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.174850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.189691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 966/1929] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:59 2022] PUT /identity/v3/projects/21d1bd995f874b85ab80a25fae8ff8d8/users/fa457d51c2414498b187e95731ecf22b/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:59.201702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.201994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.202267 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.235020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] MFA Rules not processed for user `fa457d51c2414498b187e95731ecf22b`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:59.236225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:59.248660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:59.320478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.322839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 964/1930] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:59.362547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:22:59.425017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae407718-59ad-4e0d-ac8b-6e43878539b8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.432220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.432875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.433148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.433433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.434088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.437175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.479773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 967/1931] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:22:59 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:22:59.484093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.507228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d69417-1c59-444a-88e2-3c047c2663ef None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.585976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.586610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.586891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.587164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.587796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.589747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.625516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 965/1932] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:22:59 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:22:59.626896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.637846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2755a1-214b-4c23-8511-00a91bea92ab admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.642564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.643176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.643454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.643728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.644369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.646045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.658849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 968/1933] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:59.662824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.673571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20bbd9d-0763-4fe8-8983-cf42d5372150 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.679206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.679881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.680161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.680467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] PATH_INFO: `/v3/projects/edde35db221441a18f39164213c17a77/users/594a3266229644ea941dc7d20dc3141e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.700170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edde35db221441a18f39164213c17a77, user_id=594a3266229644ea941dc7d20dc3141e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.703651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.719169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 966/1934] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:59 2022] PUT /identity/v3/projects/edde35db221441a18f39164213c17a77/users/594a3266229644ea941dc7d20dc3141e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:59.723113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.734776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0b1ff-82c5-4029-9548-1c17a589ea54 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.791291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e751c-82f6-49d9-940e-b5312a121417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.791905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e751c-82f6-49d9-940e-b5312a121417 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.792180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e751c-82f6-49d9-940e-b5312a121417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.792496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e751c-82f6-49d9-940e-b5312a121417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.793131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e751c-82f6-49d9-940e-b5312a121417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.794730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e751c-82f6-49d9-940e-b5312a121417 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.804967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 969/1935] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:22:59.810965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.821323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895b27-f364-43f7-aa6f-815c4479efd1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:22:59.826289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:22:59.827084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.827367 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.827630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] PATH_INFO: `/v3/projects/edde35db221441a18f39164213c17a77/users/594a3266229644ea941dc7d20dc3141e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.829594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edde35db221441a18f39164213c17a77, user_id=594a3266229644ea941dc7d20dc3141e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:22:59.832238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:22:59.845935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 967/1936] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:22:59 2022] PUT /identity/v3/projects/edde35db221441a18f39164213c17a77/users/594a3266229644ea941dc7d20dc3141e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:22:59.857515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:22:59.857900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:22:59.858218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:22:59.887241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] MFA Rules not processed for user `594a3266229644ea941dc7d20dc3141e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:22:59.889035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:22:59.959411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 970/1937] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:22:59.971304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:22:59.973363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:00.035003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae374c-d3a7-4856-b66e-cdc6f5aaf4e4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:00.039203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2abe3ae-a46d-4776-b3d8-859dc3ab786f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:00.039797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe3ae-a46d-4776-b3d8-859dc3ab786f service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:00.040121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe3ae-a46d-4776-b3d8-859dc3ab786f service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:00.040354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2abe3ae-a46d-4776-b3d8-859dc3ab786f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:00.050392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abe3ae-a46d-4776-b3d8-859dc3ab786f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:00.051774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2abe3ae-a46d-4776-b3d8-859dc3ab786f service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:00.063889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 968/1938] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:22:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:01.056491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.082599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:01.157796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db507aed-1883-42fc-a108-581bbac0d010 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.166078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.167063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.167380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.167687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] PATH_INFO: `/v3/users/fa457d51c2414498b187e95731ecf22b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.169000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa457d51c2414498b187e95731ecf22b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.172220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.247555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa457d51c2414498b187e95731ecf22b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.266389 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa457d51c2414498b187e95731ecf22b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.277000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa457d51c2414498b187e95731ecf22b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.277975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa457d51c2414498b187e95731ecf22b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.308625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa457d51c2414498b187e95731ecf22b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.323156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 971/1939] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:01 2022] DELETE /identity/v3/users/fa457d51c2414498b187e95731ecf22b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:01.329671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.331281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.331880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.393681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:01.393681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.394072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:01.394344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.396349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.479448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 969/1940] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:01.479617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32972ad7-5df3-49cc-85f3-1d8b49285535 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.479713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.479713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.488754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.489556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.489838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.490393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.492194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.494037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b18b7-f6ae-4253-b1d1-49743f674c42 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.499000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.499794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.500064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.500324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] PATH_INFO: `/v3/users/929f45f00fbc40dc9a0897b5c8b49394` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.501475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=929f45f00fbc40dc9a0897b5c8b49394)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.503454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.546879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:01.559896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '929f45f00fbc40dc9a0897b5c8b49394'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.560513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.562974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.570225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '929f45f00fbc40dc9a0897b5c8b49394'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.570884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '929f45f00fbc40dc9a0897b5c8b49394'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.575156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 972/1941] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:01.577397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.579647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.603160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '929f45f00fbc40dc9a0897b5c8b49394'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.604043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e81b7bd9-76a3-47e9-9c03-775d7fca7e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '929f45f00fbc40dc9a0897b5c8b49394'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:01.620771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 970/1942] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:01 2022] DELETE /identity/v3/users/929f45f00fbc40dc9a0897b5c8b49394 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:01.625787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.625944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.626159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.646502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:01.647840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.703766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01de713-45d2-4dbe-88f7-ad0fe1db3910 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.734768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 971/1943] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:01.741434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:01.743210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.778171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.778593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.778891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.779085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:01.779249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.782485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:01.799317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.801027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.811613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 973/1944] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:01.815982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eed72-8a50-47c5-a45a-4b6aba856ede None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:01.819681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:01.820294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:01.820628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:01.820896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:01.830768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:01.832216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:01.843481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 972/1945] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:02.223773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.225253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.413119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354185f-5f17-4979-a652-6df6487daaa1 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.423233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.424087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.428623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.430365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.433433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.539917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.539917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.541316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.542855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.545898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:02.555745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 974/1946] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:02.560594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492d46-aa71-4482-a5a8-9597172a6968 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.573582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.575840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.576085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.576471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] PATH_INFO: `/v3/projects/21d1bd995f874b85ab80a25fae8ff8d8` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.578594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d1bd995f874b85ab80a25fae8ff8d8)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.580536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.686750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d1bd995f874b85ab80a25fae8ff8d8', 'request_id': 'req-12617666-c339-4c93-a061-bfe48ac59863'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.696108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d1bd995f874b85ab80a25fae8ff8d8', 'request_id': 'req-12617666-c339-4c93-a061-bfe48ac59863'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.707302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d1bd995f874b85ab80a25fae8ff8d8', 'request_id': 'req-12617666-c339-4c93-a061-bfe48ac59863'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.734096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] The token cache is being invalidate because project 21d1bd995f874b85ab80a25fae8ff8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:02.734393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.735136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.739540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 973/1947] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:02 2022] DELETE /identity/v3/projects/21d1bd995f874b85ab80a25fae8ff8d8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:02.740897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.764612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd1a2-e2f6-4612-85bc-d6c446811a96 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.769865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.771497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.846259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.847177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.847658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.848093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] PATH_INFO: `/v3/users/594a3266229644ea941dc7d20dc3141e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.849258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=594a3266229644ea941dc7d20dc3141e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.851224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.867435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12617666-c339-4c93-a061-bfe48ac59863 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:02.872211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:02.872943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.873305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.873710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] PATH_INFO: `/v3/users/e18670b2e8bf4d088f392468446ed584` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:02.874926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18670b2e8bf4d088f392468446ed584)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:02.877005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:02.906833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '594a3266229644ea941dc7d20dc3141e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.914709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '594a3266229644ea941dc7d20dc3141e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.923579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '594a3266229644ea941dc7d20dc3141e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.924206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '594a3266229644ea941dc7d20dc3141e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.931818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18670b2e8bf4d088f392468446ed584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.934595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:02.941128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '594a3266229644ea941dc7d20dc3141e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.941513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18670b2e8bf4d088f392468446ed584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.942739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18670b2e8bf4d088f392468446ed584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.948310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 975/1948] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:02 2022] DELETE /identity/v3/users/594a3266229644ea941dc7d20dc3141e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:02.952071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:02.956465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:02.963065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18670b2e8bf4d088f392468446ed584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.964021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c69ed8ad-e9f8-4442-99f5-5e66d246de5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18670b2e8bf4d088f392468446ed584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:02.984895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 974/1949] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:02 2022] DELETE /identity/v3/users/e18670b2e8bf4d088f392468446ed584 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:02.986143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:02.986973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:02.987250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.010814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:03.012051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.036879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b3b97-9f95-4bb9-b2ba-e21df4903d9f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.064523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:03.088081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 975/1950] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:03.098732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.100556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.112059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:03.112755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.113166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.113446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] PATH_INFO: `/v3/projects/2508a6cf71d542659f881bdec5b429eb` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.114584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2508a6cf71d542659f881bdec5b429eb)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:03.116659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:03.167613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9949fd-d7ca-4176-8f87-caca7c3580e7 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.176755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2508a6cf71d542659f881bdec5b429eb', 'request_id': 'req-597bab08-bede-4769-9399-3cbd22e3eb6a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.184471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2508a6cf71d542659f881bdec5b429eb', 'request_id': 'req-597bab08-bede-4769-9399-3cbd22e3eb6a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.191909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2508a6cf71d542659f881bdec5b429eb', 'request_id': 'req-597bab08-bede-4769-9399-3cbd22e3eb6a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.214020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] The token cache is being invalidate because project 2508a6cf71d542659f881bdec5b429eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:03.214304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.215230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.216535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 976/1951] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:02 2022] DELETE /identity/v3/projects/2508a6cf71d542659f881bdec5b429eb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:03.220600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.222370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.238446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:03.239082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.239361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.239627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.242844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.309355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:03.323854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bab08-bede-4769-9399-3cbd22e3eb6a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.330383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:03.331160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.331504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.331775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] PATH_INFO: `/v3/users/88f23d919153495fb38b7c104ab4742e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.333103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f23d919153495fb38b7c104ab4742e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:03.336256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:03.365828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:03.367277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:03.382447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 976/1952] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:03.383333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.385734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.403059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c957bf-8211-4067-a9fc-b1beede19eeb service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.407070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f23d919153495fb38b7c104ab4742e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.417112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:03.417283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.417636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.417813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] PATH_INFO: `/v3/projects/edde35db221441a18f39164213c17a77` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.421097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f23d919153495fb38b7c104ab4742e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.422307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edde35db221441a18f39164213c17a77)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:03.430823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:03.432103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:03.436370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f23d919153495fb38b7c104ab4742e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.437967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f23d919153495fb38b7c104ab4742e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.466059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-53b03597-9be4-47e8-a67a-7932f0e4802a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f23d919153495fb38b7c104ab4742e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.480808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 977/1953] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:03 2022] DELETE /identity/v3/users/88f23d919153495fb38b7c104ab4742e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:03.525545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edde35db221441a18f39164213c17a77', 'request_id': 'req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.531868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edde35db221441a18f39164213c17a77', 'request_id': 'req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.538512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edde35db221441a18f39164213c17a77', 'request_id': 'req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.557610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] The token cache is being invalidate because project edde35db221441a18f39164213c17a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:03.558299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.558987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6fe5505b-b22b-4bf3-addc-26b6bc8c4b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:03.563116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 977/1954] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:03 2022] DELETE /identity/v3/projects/edde35db221441a18f39164213c17a77 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:03.568353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.568876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.569354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.598640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:03.600370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.707552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 978/1955] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:03.709871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a190-a880-4a82-9555-5386beb31502 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.710208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a190-a880-4a82-9555-5386beb31502 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.710452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222a190-a880-4a82-9555-5386beb31502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.751609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f222a190-a880-4a82-9555-5386beb31502 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:03.752866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f222a190-a880-4a82-9555-5386beb31502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:03.772125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 978/1956] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:03.773734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.788740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdeb137-cc8d-41ac-b4c9-541987ae1df8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.801214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:03.802046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.802330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.802598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.803657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:03.803965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:03.805742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:03.828570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a190-a880-4a82-9555-5386beb31502 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.830543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 979/1957] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:03.843993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222a190-a880-4a82-9555-5386beb31502 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.853174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:03.853799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:03.854131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:03.856757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:03.857425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:03.860543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:03.918594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 979/1958] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:03 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:03.923775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.936622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557ca64-a080-478a-88a0-a5a46e94a7a4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:03.985654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:03.989226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.049174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.060534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.061133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.061553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.064019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.068776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.136458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 980/1959] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:03 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:04.136458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.137965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.146183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63c0bb-443b-4754-8a3b-c31adbf49746 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.150736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1168164-5a73-4135-8bf7-0faa8fd0e76d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.152601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.153307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.153593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.153851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] PATH_INFO: `/v3/projects/50098eba78034c61bafebd9e5404d04b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.155254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] RBAC: Authorizing `identity:delete_project(project_id=50098eba78034c61bafebd9e5404d04b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.155682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.156369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.156745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.157084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] PATH_INFO: `/v3/projects/552997fc022d45bb9f68f6886bfd243f` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.157192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.158425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] RBAC: Authorizing `identity:delete_project(project_id=552997fc022d45bb9f68f6886bfd243f)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.160522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.214837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:04.227208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:04.229803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552997fc022d45bb9f68f6886bfd243f', 'request_id': 'req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.237244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50098eba78034c61bafebd9e5404d04b', 'request_id': 'req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.237532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552997fc022d45bb9f68f6886bfd243f', 'request_id': 'req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.246410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50098eba78034c61bafebd9e5404d04b', 'request_id': 'req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.247553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552997fc022d45bb9f68f6886bfd243f', 'request_id': 'req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.254399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50098eba78034c61bafebd9e5404d04b', 'request_id': 'req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.265410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] The token cache is being invalidate because project 552997fc022d45bb9f68f6886bfd243f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:04.265827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.266432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.268433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 981/1960] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:04 2022] DELETE /identity/v3/projects/552997fc022d45bb9f68f6886bfd243f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:04.269313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.271197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.287486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] The token cache is being invalidate because project 50098eba78034c61bafebd9e5404d04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:04.289235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.290243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.293038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 980/1961] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:03 2022] DELETE /identity/v3/projects/50098eba78034c61bafebd9e5404d04b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:04.297206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.299643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.381782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a8f50-315b-4c4d-8489-1fd30a3edcef admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.386768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.387439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.387553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bc8e5-4f43-4ce0-afb3-daf9da43d24f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.388000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.388000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] PATH_INFO: `/v3/users/66b61bcee9fc45dd9a590c38f03107d0` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.389442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b61bcee9fc45dd9a590c38f03107d0)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.391431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.395145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd66365-fe1e-4e34-a3ff-7c4fa7dddadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.396278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd66365-fe1e-4e34-a3ff-7c4fa7dddadf admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.396768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd66365-fe1e-4e34-a3ff-7c4fa7dddadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.397105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd66365-fe1e-4e34-a3ff-7c4fa7dddadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.397847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd66365-fe1e-4e34-a3ff-7c4fa7dddadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.399549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd66365-fe1e-4e34-a3ff-7c4fa7dddadf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.410849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 982/1962] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:04.413765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.414071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.414741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.435831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:04.437257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.443770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b61bcee9fc45dd9a590c38f03107d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.452159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 983/1963] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:04.452159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.452159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.458513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b61bcee9fc45dd9a590c38f03107d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.459257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b61bcee9fc45dd9a590c38f03107d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.460493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb1b46-27c9-4ad1-a50b-d426b59355ca None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.465108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a180f2-241e-4070-9a6f-af3156ec6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.465788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a180f2-241e-4070-9a6f-af3156ec6009 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.466061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a180f2-241e-4070-9a6f-af3156ec6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.466321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a180f2-241e-4070-9a6f-af3156ec6009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.467290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a180f2-241e-4070-9a6f-af3156ec6009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.469079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a180f2-241e-4070-9a6f-af3156ec6009 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.472264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b61bcee9fc45dd9a590c38f03107d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.472952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b61bcee9fc45dd9a590c38f03107d0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:04.479848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 984/1964] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:04.481863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.482224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.482707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.485189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 981/1965] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:04 2022] DELETE /identity/v3/users/66b61bcee9fc45dd9a590c38f03107d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:04.485971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.487265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.507187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:04.508593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.535079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:04.563090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fb28b-09b6-499b-8580-b366c1792e8e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.568661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b560a-cd76-4bb0-b0bc-68f4d99718c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.569340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b560a-cd76-4bb0-b0bc-68f4d99718c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.569642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b560a-cd76-4bb0-b0bc-68f4d99718c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.569872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b560a-cd76-4bb0-b0bc-68f4d99718c2 admin admin] PATH_INFO: `/v3/projects/735e08ce81cb4a2a901619cb33e07ee1/users/544b4493547d4da1b47f555ef067756c/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.575202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 985/1966] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:04.580533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.587237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b560a-cd76-4bb0-b0bc-68f4d99718c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735e08ce81cb4a2a901619cb33e07ee1, user_id=544b4493547d4da1b47f555ef067756c, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.590056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b560a-cd76-4bb0-b0bc-68f4d99718c2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.594529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4aba6-e3bf-4dc6-9f17-e9a816b45f23 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.599512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.600179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.600478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.600764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.601385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:04.601680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.603327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.607018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 982/1967] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:04 2022] PUT /identity/v3/projects/735e08ce81cb4a2a901619cb33e07ee1/users/544b4493547d4da1b47f555ef067756c/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:04.621261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 986/1968] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:04.621453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.621453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.621453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.622581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.635502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e7d33-1f28-41a6-8b1c-f58aa0f9fab7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.650809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] MFA Rules not processed for user `544b4493547d4da1b47f555ef067756c`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:04.651678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.693870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:04.727012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.728236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.728543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.728813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.729492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.731539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.755056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 983/1969] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:04.766763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 987/1970] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:04 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:04.770496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.772099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.773358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.847378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cdf6b-e206-4c8c-871a-29429ac89de0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.857430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.858693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.859022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.859355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.860878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.863711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.868577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4a393-b7de-4d73-915f-ff3575947886 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.900989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 988/1971] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:04 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:04.902005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:04.905205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:04.924017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739c35c-769d-41aa-ab3b-878da0b69098 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:04.930783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.931955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.932236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.932563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] PATH_INFO: `/v3/projects/a46448e7cb23498ebc56ff588b61ebd2` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:04.933739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46448e7cb23498ebc56ff588b61ebd2)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:04.936135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:04.988583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f671471-c1f1-4ad7-8047-746f44e72bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:04.989230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f671471-c1f1-4ad7-8047-746f44e72bcc service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:04.989499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f671471-c1f1-4ad7-8047-746f44e72bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:04.989763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f671471-c1f1-4ad7-8047-746f44e72bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.010066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:05.019178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46448e7cb23498ebc56ff588b61ebd2', 'request_id': 'req-599de398-1cb8-45cf-a56d-c35a0abdd44c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.025979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46448e7cb23498ebc56ff588b61ebd2', 'request_id': 'req-599de398-1cb8-45cf-a56d-c35a0abdd44c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.034929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46448e7cb23498ebc56ff588b61ebd2', 'request_id': 'req-599de398-1cb8-45cf-a56d-c35a0abdd44c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.053156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] The token cache is being invalidate because project a46448e7cb23498ebc56ff588b61ebd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:05.053505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.054964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.055467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f671471-c1f1-4ad7-8047-746f44e72bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.056582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 989/1972] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:04 2022] DELETE /identity/v3/projects/a46448e7cb23498ebc56ff588b61ebd2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:05.057439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.057900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f671471-c1f1-4ad7-8047-746f44e72bcc service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.059168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.069177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 984/1973] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:05.080652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.080934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.081202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.108659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:05.109759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.117013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:05.158187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de398-1cb8-45cf-a56d-c35a0abdd44c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.163116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.163738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.164016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.164279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.166230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.167030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.182200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 990/1974] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:05.184177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.186352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.208156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045f4b8-8742-4ef6-9ad8-7d7674cf1c93 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.209041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 985/1975] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:05.209687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.220539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.222048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.222551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.223189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85675b-7a0d-44a4-89c2-7a865777b1b4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.223513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] PATH_INFO: `/v3/users/544b4493547d4da1b47f555ef067756c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.226476 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=544b4493547d4da1b47f555ef067756c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.228352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66e39d-398e-4dac-9f2a-b522381e8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.229000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66e39d-398e-4dac-9f2a-b522381e8dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.229188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.229286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66e39d-398e-4dac-9f2a-b522381e8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.229533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66e39d-398e-4dac-9f2a-b522381e8dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.230269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66e39d-398e-4dac-9f2a-b522381e8dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.231847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66e39d-398e-4dac-9f2a-b522381e8dd5 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.243443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 986/1976] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:05.245316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.245316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.245316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.270592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:05.273504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.286807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 987/1977] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:05.288521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.302372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48863c8d-4feb-4abb-987c-1eba4170c3c4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.304836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544b4493547d4da1b47f555ef067756c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.308170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94dbc5-d5a6-4aaa-b597-f4bb0457ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.310148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94dbc5-d5a6-4aaa-b597-f4bb0457ec45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.310748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94dbc5-d5a6-4aaa-b597-f4bb0457ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.311262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94dbc5-d5a6-4aaa-b597-f4bb0457ec45 admin admin] PATH_INFO: `/v3/projects/c3508b8c833c491592b90ad7e9ed48fc/users/08be51fe2f1e4a3ab8c926670e3e9d51/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.319830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544b4493547d4da1b47f555ef067756c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.332960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544b4493547d4da1b47f555ef067756c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.334335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544b4493547d4da1b47f555ef067756c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.350631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94dbc5-d5a6-4aaa-b597-f4bb0457ec45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3508b8c833c491592b90ad7e9ed48fc, user_id=08be51fe2f1e4a3ab8c926670e3e9d51, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.350940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544b4493547d4da1b47f555ef067756c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:05.358043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94dbc5-d5a6-4aaa-b597-f4bb0457ec45 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.358223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 991/1978] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:05 2022] DELETE /identity/v3/users/544b4493547d4da1b47f555ef067756c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:05.359272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.361451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.396516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 988/1979] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:05 2022] PUT /identity/v3/projects/c3508b8c833c491592b90ad7e9ed48fc/users/08be51fe2f1e4a3ab8c926670e3e9d51/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:05.396516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d834f-2374-42d7-b8d8-a01fe2119b7e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.396516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d834f-2374-42d7-b8d8-a01fe2119b7e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.396516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d834f-2374-42d7-b8d8-a01fe2119b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.437334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-379d834f-2374-42d7-b8d8-a01fe2119b7e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:05.438661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-379d834f-2374-42d7-b8d8-a01fe2119b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.455375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427f864f-4867-423d-95ee-ec70787538fc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.576604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:05.595023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 989/1980] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:05.596718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.597010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.597277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.609054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.610568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.611346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.612325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.613296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:05.614040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.616007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.633454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 992/1981] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:05.634849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.638014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.652284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] MFA Rules not processed for user `08be51fe2f1e4a3ab8c926670e3e9d51`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:05.653767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.665737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:05.742012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 990/1982] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:05.743104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.762217 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328cbee-7ff8-4752-b171-af91282ea617 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.763197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb1df0-3950-4aa6-91a4-0ce21efc7027 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.766746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.767374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.768005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.768005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.770955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.772411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.772844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.773172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.775448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.776733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.779886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.781750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.802455 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 993/1983] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:05.803280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.804840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:05.837694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 991/1984] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:05.842098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:05.932119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409440b8-78cd-4d14-ab8e-c1edc677d078 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.947460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a348e-d141-439f-b279-dd6bd0d224f8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:05.954226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.954918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.955256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.955629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.956331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:05.958600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:05.985026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1498096-aae4-4040-b22c-7ad8f7a54dda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:05.985647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498096-aae4-4040-b22c-7ad8f7a54dda service glance] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:05.985919 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498096-aae4-4040-b22c-7ad8f7a54dda service glance] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:05.986186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1498096-aae4-4040-b22c-7ad8f7a54dda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:05.987846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 992/1985] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:05 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:05.991740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.005847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9156e-a330-4dcd-a6f5-bb7c796a7802 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.019056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.019658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.019944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.020189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.020836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.022443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.040161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 993/1986] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:23:06.043688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.055056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:06.056365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038c41-119c-4bed-9027-c8b5d8e2388a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.062372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.063020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.063427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.063728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.064419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.066456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.074413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498096-aae4-4040-b22c-7ad8f7a54dda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.076205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1498096-aae4-4040-b22c-7ad8f7a54dda service glance] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.077818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 994/1987] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:23:06.082882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.096309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 994/1988] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:06.104979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596cce0a-5322-4d0e-b358-9ca98bde2ffa admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.116407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.117192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.117485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.117763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] PATH_INFO: `/v3/projects/cf31373a14f04726bd04af6c59882f2e/users/8645f6bedcf946d6bbefed1428c18e1a/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.144919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf31373a14f04726bd04af6c59882f2e, user_id=8645f6bedcf946d6bbefed1428c18e1a, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.148361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.170876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 995/1989] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:06 2022] PUT /identity/v3/projects/cf31373a14f04726bd04af6c59882f2e/users/8645f6bedcf946d6bbefed1428c18e1a/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:06.182096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.182444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.182802 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.236517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] MFA Rules not processed for user `8645f6bedcf946d6bbefed1428c18e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:06.237850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.279497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.282061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.367339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:06.398124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 995/1990] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:06.403256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.484809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382fa50-e82a-46b8-9916-57d13a84a38d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.492091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ef9eb-d63f-464a-894e-f0e6e2fc506b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.498175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.499878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.500213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.500590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.501418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.503932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.507644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.508984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.511737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.512332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] PATH_INFO: `/v3/projects/735e08ce81cb4a2a901619cb33e07ee1` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.517094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735e08ce81cb4a2a901619cb33e07ee1)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.522251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.567882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 996/1991] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:06 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:06.574051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.689785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735e08ce81cb4a2a901619cb33e07ee1', 'request_id': 'req-cd090ae5-b770-40b6-8adc-04be63ea18b8'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.704467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735e08ce81cb4a2a901619cb33e07ee1', 'request_id': 'req-cd090ae5-b770-40b6-8adc-04be63ea18b8'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.721550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735e08ce81cb4a2a901619cb33e07ee1', 'request_id': 'req-cd090ae5-b770-40b6-8adc-04be63ea18b8'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.748851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] The token cache is being invalidate because project 735e08ce81cb4a2a901619cb33e07ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:06.751948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.752453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cd090ae5-b770-40b6-8adc-04be63ea18b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:06.759811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 996/1992] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:06 2022] DELETE /identity/v3/projects/735e08ce81cb4a2a901619cb33e07ee1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:06.762232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0ea9-6fac-4dc5-abc5-84fd19e6f250 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.763370 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0ea9-6fac-4dc5-abc5-84fd19e6f250 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.763370 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0ea9-6fac-4dc5-abc5-84fd19e6f250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.766863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:06.776029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa64b8-389c-4934-ae07-bd977119dbde admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:06.808552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-962e0ea9-6fac-4dc5-abc5-84fd19e6f250 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:06.809854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-962e0ea9-6fac-4dc5-abc5-84fd19e6f250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.907593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:06.908924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.909348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.909631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:06.910499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:06.912967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:06.967447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 997/1993] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:06 2022] POST /identity/v3/users => generated 297 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:06.972367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:06.974733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:06.978512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 997/1994] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:06.987041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:06.987578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:06.988206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.012696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cebb1-ee20-4834-8cdb-3444fcbe74cb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.026932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:07.029556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.030355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.034084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.034084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.034084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.035399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.040218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.049122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 998/1995] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:07.051137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.059472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.069405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e11e9a-30a5-440a-bff3-958afdcdfaa4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.082455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.083242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.083588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 998/1996] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:07.084224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.084955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] PATH_INFO: `/v3/users/efacc4fe861a43f58acfeccd507e65d5` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.086321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.087531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efacc4fe861a43f58acfeccd507e65d5)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.103760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.115500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c62efc-9498-45a9-ac63-52fa1bf11854 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.128302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.129303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.129584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.129853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.130506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:07.130805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.138124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.163556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 999/1997] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:07.164704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.186135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b83887-1f43-4fdf-998e-f896f9073e55 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.192417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efacc4fe861a43f58acfeccd507e65d5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.193384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.194387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.194803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.195304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] PATH_INFO: `/v3/projects/b64f157985434baf95b8102b16384244/users/ef226f03622047a69fae6a9d10d79fb1/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.196203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:07.209283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efacc4fe861a43f58acfeccd507e65d5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.210477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efacc4fe861a43f58acfeccd507e65d5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.228172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64f157985434baf95b8102b16384244, user_id=ef226f03622047a69fae6a9d10d79fb1, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.234200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.241872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efacc4fe861a43f58acfeccd507e65d5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.244765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efacc4fe861a43f58acfeccd507e65d5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:07.255195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1000/1998] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:07 2022] PUT /identity/v3/projects/b64f157985434baf95b8102b16384244/users/ef226f03622047a69fae6a9d10d79fb1/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:07.256339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.259599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.291800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 999/1999] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:07 2022] DELETE /identity/v3/users/efacc4fe861a43f58acfeccd507e65d5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:07.293321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.296648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.351486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb7e0b-0491-45fd-80dc-6c80e68671bd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.416434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f94a87-b0b7-46fa-9e0c-6f71a7ea7633 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.422254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c605524-44b0-4d73-a8eb-982e93d4b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.423320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605524-44b0-4d73-a8eb-982e93d4b379 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.423596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605524-44b0-4d73-a8eb-982e93d4b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.423889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c605524-44b0-4d73-a8eb-982e93d4b379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.425137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605524-44b0-4d73-a8eb-982e93d4b379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.425269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:07.426921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c605524-44b0-4d73-a8eb-982e93d4b379 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.436302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.437065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.437337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.437626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.438216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.438697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1000/2000] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:07.440458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.440743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.441021 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.443834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.462031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:07.463254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.475531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1001/2001] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:07.476461 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.481025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1001/2002] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:07.487303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.487892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47951a0f-a7b5-4605-8800-f516bd9ea6f7 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.569647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.570962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.571909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.572327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] PATH_INFO: `/v3/projects/b64f157985434baf95b8102b16384244/users/ef226f03622047a69fae6a9d10d79fb1/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.573258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241dc83-2b0c-433b-ad24-51420976a87a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.580774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966d63c-373c-4f9b-9f35-57293be55526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.582063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d63c-373c-4f9b-9f35-57293be55526 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.582467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d63c-373c-4f9b-9f35-57293be55526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.582957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d63c-373c-4f9b-9f35-57293be55526 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.583305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64f157985434baf95b8102b16384244, user_id=ef226f03622047a69fae6a9d10d79fb1, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.583836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966d63c-373c-4f9b-9f35-57293be55526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.585980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966d63c-373c-4f9b-9f35-57293be55526 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.586616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.603040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1002/2003] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:07 2022] PUT /identity/v3/projects/b64f157985434baf95b8102b16384244/users/ef226f03622047a69fae6a9d10d79fb1/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:07.604111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.606040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.626352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1002/2004] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:23:07.630812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.631190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.631474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.663537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] MFA Rules not processed for user `ef226f03622047a69fae6a9d10d79fb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:07.664778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.675818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dfbd8-d431-4451-9587-334b08b89a0c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.679953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.680794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.681082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.681445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.689225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:07.771917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.774479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.781448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1003/2005] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:07.781448 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.787414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1003/2006] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:07.790461 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.793028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:07.802831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc17e7-4adb-41b8-9d5a-ef386b654f9a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.811843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.812856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.813282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.813814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.815168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.819108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.845005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1004/2007] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:07.846416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.882957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a914116-1d0a-4e40-9986-388490da3bba admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.894817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.896510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173151b0-2d97-4547-9ee2-201bae9e4c82 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.899148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.899655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.900098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.901521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.903341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c341faf-9438-4820-af0c-93ee74c8c5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.904589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341faf-9438-4820-af0c-93ee74c8c5fc service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.904983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341faf-9438-4820-af0c-93ee74c8c5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.908430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c341faf-9438-4820-af0c-93ee74c8c5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:07.908602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.926274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341faf-9438-4820-af0c-93ee74c8c5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:07.927941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1005/2008] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:07.929203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c341faf-9438-4820-af0c-93ee74c8c5fc service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:07.933401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:07.946885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1004/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:07.966666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba1819-b8cf-4ffa-9bdf-b18a2719d1ae admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:07.986978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:07.988270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:07.988727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:07.992324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] PATH_INFO: `/v3/projects/233a77c7bc4b4625aeda513d92c6fb87/users/dbf351d15e5c431781efa4f5d91553c7/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.041222 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=233a77c7bc4b4625aeda513d92c6fb87, user_id=dbf351d15e5c431781efa4f5d91553c7, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:08.047097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:08.091523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:08.092139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1006/2010] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:07 2022] PUT /identity/v3/projects/233a77c7bc4b4625aeda513d92c6fb87/users/dbf351d15e5c431781efa4f5d91553c7/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:08.092435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:08.092810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.108358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:08.110242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:08.128979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:08.163634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] MFA Rules not processed for user `dbf351d15e5c431781efa4f5d91553c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:08.166899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:08.230976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2614bb1-41ef-4d19-8467-aa7619994eea admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:08.247447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:08.249184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:08.249582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:08.250094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.253004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:08.336845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1005/2011] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:08.346393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:08.348368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:08.376015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:08.381320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:08.432396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:08.435269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1007/2012] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:08.438286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:08.460690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:08.510942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d07a0-0e23-4059-906a-64bcc97d8f94 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:08.517327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:08.518789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:08.519249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:08.520171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.537348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:08.539437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:08.577780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1006/2013] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:23:08.670587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb82d2-2ee4-44dc-974a-4917e7eaffdc service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:08.679879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:08.680585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:08.680884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:08.681122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] PATH_INFO: `/v3/projects/7d5b5b0983a1413b93b48e0a66b93cbd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.684796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5b5b0983a1413b93b48e0a66b93cbd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:08.689774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:08.777507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5b5b0983a1413b93b48e0a66b93cbd', 'request_id': 'req-61f8e10d-7561-4450-b006-d11452650aee'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:08.787398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5b5b0983a1413b93b48e0a66b93cbd', 'request_id': 'req-61f8e10d-7561-4450-b006-d11452650aee'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:08.799474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5b5b0983a1413b93b48e0a66b93cbd', 'request_id': 'req-61f8e10d-7561-4450-b006-d11452650aee'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:08.801827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:08.823987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] The token cache is being invalidate because project 7d5b5b0983a1413b93b48e0a66b93cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:08.824331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:08.824936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:08.839827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1008/2014] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:08 2022] DELETE /identity/v3/projects/7d5b5b0983a1413b93b48e0a66b93cbd => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:08.843971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:08.856639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9839ac-ba28-487a-8cb8-2f0557aa41ab service glance] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:08.942551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:08.943213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:08.943490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:08.943770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] PATH_INFO: `/v3/users/f91a364b55e4484f8ae82b0a0eb0b584` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:08.945056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f91a364b55e4484f8ae82b0a0eb0b584)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:08.947348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:09.044230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f91a364b55e4484f8ae82b0a0eb0b584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.063011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f91a364b55e4484f8ae82b0a0eb0b584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.063860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f91a364b55e4484f8ae82b0a0eb0b584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.097773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f91a364b55e4484f8ae82b0a0eb0b584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.097773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f91a364b55e4484f8ae82b0a0eb0b584'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.120187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1007/2015] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:08 2022] DELETE /identity/v3/users/f91a364b55e4484f8ae82b0a0eb0b584 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:09.483359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:09.484911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:09.499179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8e10d-7561-4450-b006-d11452650aee admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:09.586427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:09.587275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:09.587705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:09.588144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] PATH_INFO: `/v3/projects/c72a1e392b064555b8e6cc8dc97df0ff` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:09.589525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c72a1e392b064555b8e6cc8dc97df0ff)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:09.591627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:09.670730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c72a1e392b064555b8e6cc8dc97df0ff', 'request_id': 'req-2fd60017-ce9a-4c54-a3d6-6f374adebe25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.680366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c72a1e392b064555b8e6cc8dc97df0ff', 'request_id': 'req-2fd60017-ce9a-4c54-a3d6-6f374adebe25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.687379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c72a1e392b064555b8e6cc8dc97df0ff', 'request_id': 'req-2fd60017-ce9a-4c54-a3d6-6f374adebe25'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.712165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] The token cache is being invalidate because project c72a1e392b064555b8e6cc8dc97df0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:09.712461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.716435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.720454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1009/2016] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:09 2022] DELETE /identity/v3/projects/c72a1e392b064555b8e6cc8dc97df0ff => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:09.722710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:09.724663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:09.761390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c100a70-b055-4298-8879-28b59a1e0b49 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:09.852158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:09.864918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:09.866158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:09.866830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:09.867334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] PATH_INFO: `/v3/users/93f3c90c93bd48659ae27639aaa3290d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:09.869167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f3c90c93bd48659ae27639aaa3290d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:09.871431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:09.953959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f3c90c93bd48659ae27639aaa3290d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.973430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f3c90c93bd48659ae27639aaa3290d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.974263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f3c90c93bd48659ae27639aaa3290d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.992194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f3c90c93bd48659ae27639aaa3290d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:09.993689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-edd94dd7-9858-4c07-8fb7-5aaedec73cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f3c90c93bd48659ae27639aaa3290d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.015673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1008/2017] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:09 2022] DELETE /identity/v3/users/93f3c90c93bd48659ae27639aaa3290d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:10.456259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:10.456646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.478342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd60017-ce9a-4c54-a3d6-6f374adebe25 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:10.539718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:10.541696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.541696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.541696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] PATH_INFO: `/v3/projects/5d92a4f1fc7d48cc916c1c87b269f886` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.542300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d92a4f1fc7d48cc916c1c87b269f886)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:10.544212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:10.589416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:10.635578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d92a4f1fc7d48cc916c1c87b269f886', 'request_id': 'req-444cd5fd-ccb8-4a4d-877f-71348722bfd2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.647739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d92a4f1fc7d48cc916c1c87b269f886', 'request_id': 'req-444cd5fd-ccb8-4a4d-877f-71348722bfd2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.655550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d92a4f1fc7d48cc916c1c87b269f886', 'request_id': 'req-444cd5fd-ccb8-4a4d-877f-71348722bfd2'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.687868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] The token cache is being invalidate because project 5d92a4f1fc7d48cc916c1c87b269f886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:10.689747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.694951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-444cd5fd-ccb8-4a4d-877f-71348722bfd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:10.697922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1010/2018] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:10 2022] DELETE /identity/v3/projects/5d92a4f1fc7d48cc916c1c87b269f886 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:10.704422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.704422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.704422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.725961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:10.727159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.840846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1009/2019] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:10.855072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.856031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.856741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.880423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:10.881636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:10.892648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1011/2020] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:10.896629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:10.911064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfdf55-dc30-430f-a2e5-42975a8c76d8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:10.919430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:10.920505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.921286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.921625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.922681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:10.923043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:10.925291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:10.941085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1010/2021] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:23:10.945421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:10.958567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97547a-493c-40b1-8dac-75b668fe5f38 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:10.964320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:10.964972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:10.965268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:10.965589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:10.966482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:10.968990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.016645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1012/2022] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:10 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:11.018431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.029579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332cb5d-c197-4566-ac2e-0a23a6177bba admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.118958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.119949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.120370 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.120701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.121574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.124361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.134783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:11.152771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1011/2023] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:11 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:11.154852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.168858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94728a-1e7a-4fa0-b414-f40cbaf989d1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.174779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.175050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.175325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.175598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.176235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.178068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.188708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1013/2024] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:23:11.193006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.204191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdac85-70d9-489e-b722-fce8223e2cd6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.224770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91f8c2-334f-4ea9-a8db-3033898b298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.225615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f8c2-334f-4ea9-a8db-3033898b298d admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.226002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f8c2-334f-4ea9-a8db-3033898b298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.226155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91f8c2-334f-4ea9-a8db-3033898b298d admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.227035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f8c2-334f-4ea9-a8db-3033898b298d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.229038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91f8c2-334f-4ea9-a8db-3033898b298d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.245796 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1012/2025] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:11.247028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.258576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d46b46-5666-4c86-86d4-aa1ddf1d86b3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.265496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.266263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.266535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.266803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] PATH_INFO: `/v3/projects/5c3f31d61c784a48881d0ee814a11c36/users/30597a271d9940f1ab5d0ada84c019b6/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.287828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3f31d61c784a48881d0ee814a11c36, user_id=30597a271d9940f1ab5d0ada84c019b6, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.290556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.306432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1014/2026] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:11 2022] PUT /identity/v3/projects/5c3f31d61c784a48881d0ee814a11c36/users/30597a271d9940f1ab5d0ada84c019b6/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:11.318026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.318306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.318569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.350235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] MFA Rules not processed for user `30597a271d9940f1ab5d0ada84c019b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:11.351358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:11.428197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1013/2027] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:11.439720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:11.441861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:11.507306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821faaf-c357-4704-979d-29df95f2499b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:11.511416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bc047-61a0-4884-b576-90a25b5c07d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:11.512294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bc047-61a0-4884-b576-90a25b5c07d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:11.512761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bc047-61a0-4884-b576-90a25b5c07d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:11.513040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bc047-61a0-4884-b576-90a25b5c07d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:11.525049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bc047-61a0-4884-b576-90a25b5c07d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:11.526639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bc047-61a0-4884-b576-90a25b5c07d7 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:11.538502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1015/2028] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:21.421017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:21.533133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:24.819439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:24.897024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e3145-fecc-43cf-9013-ee188b30f7b8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:24.902733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:24.903381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:24.903658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:24.903927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] PATH_INFO: `/v3/users/30597a271d9940f1ab5d0ada84c019b6` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:24.905081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30597a271d9940f1ab5d0ada84c019b6)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:24.907199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:24.960329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30597a271d9940f1ab5d0ada84c019b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:24.970289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30597a271d9940f1ab5d0ada84c019b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:24.971442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30597a271d9940f1ab5d0ada84c019b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:24.987767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30597a271d9940f1ab5d0ada84c019b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:24.988893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30597a271d9940f1ab5d0ada84c019b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.002952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1014/2029] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:24 2022] DELETE /identity/v3/users/30597a271d9940f1ab5d0ada84c019b6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:25.007914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.008470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.008567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.028763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:25.030197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.112466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1016/2030] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:25.132436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.134123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.213045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590b16d-d362-4273-94a3-89cdb68fac13 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.217177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279a7e9-aaa4-4896-8bf4-b20ffd6df7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.218147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a7e9-aaa4-4896-8bf4-b20ffd6df7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.218436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a7e9-aaa4-4896-8bf4-b20ffd6df7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.218697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279a7e9-aaa4-4896-8bf4-b20ffd6df7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.236717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a7e9-aaa4-4896-8bf4-b20ffd6df7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.238685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279a7e9-aaa4-4896-8bf4-b20ffd6df7e3 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.250244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1015/2031] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:25.288899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.290386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.306569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b34693-609c-4253-8e0e-9d2358f2c768 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.317014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.317939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.318206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.318477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] PATH_INFO: `/v3/users/8645f6bedcf946d6bbefed1428c18e1a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.320415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8645f6bedcf946d6bbefed1428c18e1a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.321987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.389884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8645f6bedcf946d6bbefed1428c18e1a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.400484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8645f6bedcf946d6bbefed1428c18e1a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.414618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8645f6bedcf946d6bbefed1428c18e1a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.415792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8645f6bedcf946d6bbefed1428c18e1a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.430117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8645f6bedcf946d6bbefed1428c18e1a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.442978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1017/2032] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:25 2022] DELETE /identity/v3/users/8645f6bedcf946d6bbefed1428c18e1a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:25.444494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.444784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.445047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.466640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:25.467886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.489570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:25.548719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1016/2033] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:25.561240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.564446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.593569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.595041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.607827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135d60d-4825-49d7-acb1-aaff1c746b81 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.615806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.616579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.616862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.617138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] PATH_INFO: `/v3/projects/5c3f31d61c784a48881d0ee814a11c36` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.618318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3f31d61c784a48881d0ee814a11c36)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.621760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.645079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd67db-3306-4ae2-a1e9-5090f39640d6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.648928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d46f5-0f6c-4ce6-ae92-57faf2198e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.649543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d46f5-0f6c-4ce6-ae92-57faf2198e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.650131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d46f5-0f6c-4ce6-ae92-57faf2198e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.650131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d46f5-0f6c-4ce6-ae92-57faf2198e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.660365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d46f5-0f6c-4ce6-ae92-57faf2198e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.661909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d46f5-0f6c-4ce6-ae92-57faf2198e94 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.674555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1018/2034] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:25.692330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3f31d61c784a48881d0ee814a11c36', 'request_id': 'req-34cc3483-90e4-490f-a1d4-85f28af96bf9'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.698570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3f31d61c784a48881d0ee814a11c36', 'request_id': 'req-34cc3483-90e4-490f-a1d4-85f28af96bf9'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.708300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3f31d61c784a48881d0ee814a11c36', 'request_id': 'req-34cc3483-90e4-490f-a1d4-85f28af96bf9'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.723541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] The token cache is being invalidate because project 5c3f31d61c784a48881d0ee814a11c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:25.724440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.725167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-34cc3483-90e4-490f-a1d4-85f28af96bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:25.726707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1017/2035] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:25 2022] DELETE /identity/v3/projects/5c3f31d61c784a48881d0ee814a11c36 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:25.734766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.734766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.734766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.754209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:25.755335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.765643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:25.823791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1019/2036] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:25.832705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.833250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.833250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.853170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:25.854295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:25.865873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1018/2037] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:25.867583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.877523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295aa53-29f6-4b80-95a5-c60a77d00b3e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.883578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.884418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.884571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.884743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.885729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:25.885865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.891829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.900338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1020/2038] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:25.905145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.915342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416e4c3-a4f9-4ac1-9f9f-d2cfb38ddd4f None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:25.920668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:25.921356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:25.921691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:25.922019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:25.922702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:25.925040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:25.960712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1019/2039] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:25 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:25.962052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:25.972609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921b2c2-133c-493a-a9e2-3471ac52f462 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.045602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.046332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.046611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.046946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.047600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.049828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.074612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1021/2040] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:25 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:26.078823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:26.092094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0e044-15f8-474a-92dd-510e0eb42a84 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.099306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.100067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.100443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.100961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.102151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.103962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.130176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1020/2041] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:26.133117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:26.151140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8603c-3442-4c76-afbe-933c33caac45 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.170464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.173580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.174076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.174725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.179870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.180944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.202420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:26.204202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:26.207923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1022/2042] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:26.211989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:26.230241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d78b0a-619f-4b42-a514-c1dd8dcff1f2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.236532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69862e-84fa-42a4-b966-7b87e5a4ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.237143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69862e-84fa-42a4-b966-7b87e5a4ebf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.237453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69862e-84fa-42a4-b966-7b87e5a4ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.237736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69862e-84fa-42a4-b966-7b87e5a4ebf0 admin admin] PATH_INFO: `/v3/projects/0ac62fe9f3a0475c89fe90a95e0b03a5/users/414ad5af7f144adca5b5f77ac950c75f/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.256210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52242c3d-3c03-40c7-9e7f-4dfd5689593a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.266287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69862e-84fa-42a4-b966-7b87e5a4ebf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac62fe9f3a0475c89fe90a95e0b03a5, user_id=414ad5af7f144adca5b5f77ac950c75f, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.268271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.269482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69862e-84fa-42a4-b966-7b87e5a4ebf0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.270039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.270519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.270961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] PATH_INFO: `/v3/projects/cf31373a14f04726bd04af6c59882f2e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.272889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf31373a14f04726bd04af6c59882f2e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.276122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.301255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1023/2043] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:26 2022] PUT /identity/v3/projects/0ac62fe9f3a0475c89fe90a95e0b03a5/users/414ad5af7f144adca5b5f77ac950c75f/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:26.304063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.304826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.305105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.349279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf31373a14f04726bd04af6c59882f2e', 'request_id': 'req-986d89f0-2057-4cf9-962f-90c18ec1135e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.357935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf31373a14f04726bd04af6c59882f2e', 'request_id': 'req-986d89f0-2057-4cf9-962f-90c18ec1135e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.360321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:26.367242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] MFA Rules not processed for user `414ad5af7f144adca5b5f77ac950c75f`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:26.368770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:26.381865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf31373a14f04726bd04af6c59882f2e', 'request_id': 'req-986d89f0-2057-4cf9-962f-90c18ec1135e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.413415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] The token cache is being invalidate because project cf31373a14f04726bd04af6c59882f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:26.413974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.414978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.417069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1021/2044] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:26 2022] DELETE /identity/v3/projects/cf31373a14f04726bd04af6c59882f2e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:26.421068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:26.422448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:26.441837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:26.492480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1024/2045] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:26.493829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:26.495325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:26.507693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d89f0-2057-4cf9-962f-90c18ec1135e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.515772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.516577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.516915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.517246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] PATH_INFO: `/v3/users/ef226f03622047a69fae6a9d10d79fb1` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.518520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef226f03622047a69fae6a9d10d79fb1)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.522028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.570916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4aad-66b3-4b83-ae66-8a29c43368a5 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:26.575592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:26.576283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:26.576678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:26.577022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:26.590299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:26.593019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:26.600074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef226f03622047a69fae6a9d10d79fb1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.604754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1025/2046] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:26.611652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef226f03622047a69fae6a9d10d79fb1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.616111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef226f03622047a69fae6a9d10d79fb1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.635033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef226f03622047a69fae6a9d10d79fb1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.637542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4014b110-d8b0-4dc0-bd84-a70e90014370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef226f03622047a69fae6a9d10d79fb1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:26.659480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1022/2047] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:26 2022] DELETE /identity/v3/users/ef226f03622047a69fae6a9d10d79fb1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:27.054954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.075725 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441afe7f-17a9-45ca-8572-0f4c16dc1cd2 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.170091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.170895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.171166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.171435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] PATH_INFO: `/v3/projects/b64f157985434baf95b8102b16384244` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.172812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64f157985434baf95b8102b16384244)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.175316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.272789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64f157985434baf95b8102b16384244', 'request_id': 'req-81507bcc-00f8-4cd5-b350-75d651753d86'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:27.279186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64f157985434baf95b8102b16384244', 'request_id': 'req-81507bcc-00f8-4cd5-b350-75d651753d86'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:27.286076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64f157985434baf95b8102b16384244', 'request_id': 'req-81507bcc-00f8-4cd5-b350-75d651753d86'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:27.313092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] The token cache is being invalidate because project b64f157985434baf95b8102b16384244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:27.313505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:27.314715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81507bcc-00f8-4cd5-b350-75d651753d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:27.316466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1026/2048] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:27 2022] DELETE /identity/v3/projects/b64f157985434baf95b8102b16384244 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:27.321693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.322166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.322273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.385099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:27.386790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:27.463487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1023/2049] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:27.471491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.471780 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.472057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.496754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:27.497994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:27.506572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1027/2050] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:27.510962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.522839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f523b8-35e1-4c31-acd7-71c3ffd8b61c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.531437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.532064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.532340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.532642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.533298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:23:27.533622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.535208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.538587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:27.550247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1024/2051] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:23:27.554820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.564147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a47498-b287-4abf-bdf7-a0d1af674533 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.569525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.570138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.570417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.570685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.571312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.573877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.589469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:27.608984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1028/2052] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:27 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:27.613017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.623128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e0518-43c1-4323-94fb-90d07721b33a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.685446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.686066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.686339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.686604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.687305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.689332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.719310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1025/2053] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:27 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:27.720215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.730738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac5316-57e1-470b-9264-47f64a326ea9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.735406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.736006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.736427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.736766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.737465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.739337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.750412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1029/2054] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:23:27.754548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.764875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faee485-26e9-4099-97ee-9a6115c4a25f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.770238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d58aa-b3c3-4ecb-935c-0ccd1df7774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.770881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d58aa-b3c3-4ecb-935c-0ccd1df7774c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.771157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d58aa-b3c3-4ecb-935c-0ccd1df7774c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.771425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d58aa-b3c3-4ecb-935c-0ccd1df7774c admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.772216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d58aa-b3c3-4ecb-935c-0ccd1df7774c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.773876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d58aa-b3c3-4ecb-935c-0ccd1df7774c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.786145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1026/2055] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:27.790475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:27.802282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760127-3164-4811-a22f-2de7721bb8b3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:27.809569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:27.810253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.810541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.810793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] PATH_INFO: `/v3/projects/eec5b8913a8f4a338fff60356469f260/users/75d444724101404aae3b395b1ad5ec87/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.828242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec5b8913a8f4a338fff60356469f260, user_id=75d444724101404aae3b395b1ad5ec87, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:27.830990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:27.845857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1030/2056] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:27 2022] PUT /identity/v3/projects/eec5b8913a8f4a338fff60356469f260/users/75d444724101404aae3b395b1ad5ec87/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:23:27.857864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:27.858148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:27.858417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:27.891787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] MFA Rules not processed for user `75d444724101404aae3b395b1ad5ec87`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:27.893072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:27.960468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1027/2057] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:27.968145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.029804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f8f93-57d1-4081-a3f0-fd688c9bf98b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.034636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.035239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.035532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.035794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.036427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.038749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.070037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1031/2058] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:23:27 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:23:28.074366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.085643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617d92d-fbc5-4030-9b49-34070c7eb589 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.142830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.143442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.143714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.143975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.144624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.146537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.156714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:28.173966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1028/2059] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:23:28 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:23:28.177606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.189212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7982-daf1-46b9-bdc9-063ccaf52b47 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.196095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.196827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.197107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.197568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.198428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.200291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.212740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1032/2060] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:28.217237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.227820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a485a4-41c0-431e-849f-a5c946429c88 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.233359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.234002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.234274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.234538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] PATH_INFO: `/v3/projects/9ac9c7cd1c514faba8e96ff701616300/users/fbe05df4c48d4738817d499868606d6d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.250384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9c7cd1c514faba8e96ff701616300, user_id=fbe05df4c48d4738817d499868606d6d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.253088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.269234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1029/2061] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:28 2022] PUT /identity/v3/projects/9ac9c7cd1c514faba8e96ff701616300/users/fbe05df4c48d4738817d499868606d6d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:28.272761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.285685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9015512-5a71-4fa9-b06e-1d4c4e83f0d7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.351525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f95bb-8dbc-4d45-946b-3d593c45f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.352130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f95bb-8dbc-4d45-946b-3d593c45f7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.352423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f95bb-8dbc-4d45-946b-3d593c45f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.352714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f95bb-8dbc-4d45-946b-3d593c45f7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.353346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f95bb-8dbc-4d45-946b-3d593c45f7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.354955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f95bb-8dbc-4d45-946b-3d593c45f7c5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.368771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1033/2062] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:23:28.369891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.381193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841c094-2fa7-4856-abc8-bfb84b553684 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.386895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.387700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.388024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.388430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] PATH_INFO: `/v3/projects/9ac9c7cd1c514faba8e96ff701616300/users/fbe05df4c48d4738817d499868606d6d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.390856 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac9c7cd1c514faba8e96ff701616300, user_id=fbe05df4c48d4738817d499868606d6d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.393619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.408656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1030/2063] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:23:28 2022] PUT /identity/v3/projects/9ac9c7cd1c514faba8e96ff701616300/users/fbe05df4c48d4738817d499868606d6d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:28.418617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.419026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.419304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.453856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] MFA Rules not processed for user `fbe05df4c48d4738817d499868606d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:28.455161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:28.473316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:28.538728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1034/2064] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:23:28.549945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:28.552131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:28.623054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ece-cf89-4262-8156-c12eb55594cd admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:28.626669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:28.627277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:28.627549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:28.627806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:28.685625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:28.687056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:28.696707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1031/2065] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:38.531348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=22 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:38.691925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=3,keystone:SELECT=65 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:43.867093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:43.881121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450cebc-fd7d-45f1-8c21-84dabadd8ac8 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:43.885662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc1a14-8154-40a1-9698-a253306f1cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:43.886273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1a14-8154-40a1-9698-a253306f1cbd service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:43.886508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1a14-8154-40a1-9698-a253306f1cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:43.886807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc1a14-8154-40a1-9698-a253306f1cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:43.899367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1a14-8154-40a1-9698-a253306f1cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:43.901118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc1a14-8154-40a1-9698-a253306f1cbd service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:43.911554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1035/2066] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:44.503587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:44.505317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:44.573680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db078886-6945-4ac7-8ad4-b2631effc061 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:44.578922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:44.579562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:44.579832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:44.580100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] PATH_INFO: `/v3/users/414ad5af7f144adca5b5f77ac950c75f` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:44.581268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=414ad5af7f144adca5b5f77ac950c75f)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:44.583242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:44.634609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414ad5af7f144adca5b5f77ac950c75f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:44.643639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414ad5af7f144adca5b5f77ac950c75f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:44.644397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414ad5af7f144adca5b5f77ac950c75f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:44.657750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414ad5af7f144adca5b5f77ac950c75f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:44.658541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414ad5af7f144adca5b5f77ac950c75f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:44.670397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1032/2067] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:23:44 2022] DELETE /identity/v3/users/414ad5af7f144adca5b5f77ac950c75f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:44.675340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:44.675692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:44.675962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:44.695982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:23:44.697458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:44.759910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1036/2068] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:23:44.770988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:44.772625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:44.830676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b36afd-6a9b-4289-9cbb-846bc5f439c2 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:44.835187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:44.835746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:44.836008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:44.836293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:44.846247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:44.847701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:44.857799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1033/2069] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:23:45.143180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:23:45.144686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:23:45.161432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993984-ce14-4754-aadd-e8cda7e6f19c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:23:45.166510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:23:45.167155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:23:45.167431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:23:45.167703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] PATH_INFO: `/v3/projects/0ac62fe9f3a0475c89fe90a95e0b03a5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:23:45.168904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac62fe9f3a0475c89fe90a95e0b03a5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:23:45.171095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:23:45.224836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac62fe9f3a0475c89fe90a95e0b03a5', 'request_id': 'req-3d33e3f8-e557-490a-80a0-793ee46d1462'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:45.230740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac62fe9f3a0475c89fe90a95e0b03a5', 'request_id': 'req-3d33e3f8-e557-490a-80a0-793ee46d1462'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:45.237939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac62fe9f3a0475c89fe90a95e0b03a5', 'request_id': 'req-3d33e3f8-e557-490a-80a0-793ee46d1462'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:45.253326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] The token cache is being invalidate because project 0ac62fe9f3a0475c89fe90a95e0b03a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:23:45.253616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:45.254223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:23:45.255732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1037/2070] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:23:45 2022] DELETE /identity/v3/projects/0ac62fe9f3a0475c89fe90a95e0b03a5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:23:54.853288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:23:55.250238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:19.033497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.035671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:19.050286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2c30-7988-40d3-83a9-8b3416881c4b service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.114164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.114904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.115192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.115597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] PATH_INFO: `/v3/users/ebf95a8321a249c48d1e7f0b39a067d3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.116935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf95a8321a249c48d1e7f0b39a067d3)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.119452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.172691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf95a8321a249c48d1e7f0b39a067d3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.180816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf95a8321a249c48d1e7f0b39a067d3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.181416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf95a8321a249c48d1e7f0b39a067d3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.193656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf95a8321a249c48d1e7f0b39a067d3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.194278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-30273918-e5cb-4c4b-9cb2-43e3e8e2b905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf95a8321a249c48d1e7f0b39a067d3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.207334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1034/2071] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:19 2022] DELETE /identity/v3/users/ebf95a8321a249c48d1e7f0b39a067d3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:19.389551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.391205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:19.410801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e3f8-e557-490a-80a0-793ee46d1462 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.468696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.469322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.469600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.469870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] PATH_INFO: `/v3/projects/25f51668a0b04e4f9e51d6356b854c7b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.471009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f51668a0b04e4f9e51d6356b854c7b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.472967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.522505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f51668a0b04e4f9e51d6356b854c7b', 'request_id': 'req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.528141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f51668a0b04e4f9e51d6356b854c7b', 'request_id': 'req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.534204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f51668a0b04e4f9e51d6356b854c7b', 'request_id': 'req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.553175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] The token cache is being invalidate because project 25f51668a0b04e4f9e51d6356b854c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:19.553539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.554756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-66cba7e2-95ef-4fa3-bca6-f840f2b9636f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:19.556151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1038/2072] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:19 2022] DELETE /identity/v3/projects/25f51668a0b04e4f9e51d6356b854c7b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:19.561333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.561685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.561958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.581399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:19.582515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:19.652565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1035/2073] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:19.660772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.661050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.661316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.682260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:19.683473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:19.692457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1039/2074] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:19.697125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.708293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe7e3b-8c07-4cf1-bf58-7ddb864039ff None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.713608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.714210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.714499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.714767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.715416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:24:19.715719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.717357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.730911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1036/2075] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:24:19.737015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.749239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeb870-8302-4652-a95b-b7fcaffddcb3 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.755791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.756402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.756701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.756951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.757685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.759594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.790095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1040/2076] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:19 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:19.794330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.804289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732051c9-055d-424f-a18b-0de8dea2f71c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.808028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:19.862478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.863012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.863281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.863541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.864154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.866133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.891093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1037/2077] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:19 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:19.895276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.906377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec3c34-4519-4740-9905-12f42e512b33 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.910944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.911532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.911801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.912077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.912726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.914415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.924779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1041/2078] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:19.929227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.939600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1468d-9f4b-43cb-aef8-ae33755bcdc4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.945700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb5b12-06e1-4b88-b9ff-a01f87ee2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.946308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb5b12-06e1-4b88-b9ff-a01f87ee2335 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.946585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb5b12-06e1-4b88-b9ff-a01f87ee2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.946846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb5b12-06e1-4b88-b9ff-a01f87ee2335 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:19.947492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb5b12-06e1-4b88-b9ff-a01f87ee2335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:19.949162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebb5b12-06e1-4b88-b9ff-a01f87ee2335 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:19.960493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1038/2079] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:19.964837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:19.975470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde37b8-bde5-493e-b748-e06e9a36597a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:19.982059 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:19.982722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:19.982980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:19.983266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] PATH_INFO: `/v3/projects/12ee39a09d0b4e67898ac55e4fc8aaee/users/b6717f94a3844d1b82817e0f4adcebad/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:20.000094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ee39a09d0b4e67898ac55e4fc8aaee, user_id=b6717f94a3844d1b82817e0f4adcebad, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:20.003149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:20.019288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1042/2080] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:19 2022] PUT /identity/v3/projects/12ee39a09d0b4e67898ac55e4fc8aaee/users/b6717f94a3844d1b82817e0f4adcebad/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:24:20.025785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128c3e-9366-4fe2-9563-4fc2c846d38b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:20.026065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128c3e-9366-4fe2-9563-4fc2c846d38b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:20.026336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c128c3e-9366-4fe2-9563-4fc2c846d38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:20.046098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7c128c3e-9366-4fe2-9563-4fc2c846d38b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:20.047285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7c128c3e-9366-4fe2-9563-4fc2c846d38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:20.106818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1039/2081] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:20.117223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:20.118947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:20.157840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:20.188705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b93da-df96-4731-b430-9292ffc32d53 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:20.192261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:20.192896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:20.193171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:20.193432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:20.202421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:20.203874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:20.213202 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1043/2082] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:24.527610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:24.528104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:24.528211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:24.561353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] MFA Rules not processed for user `b6717f94a3844d1b82817e0f4adcebad`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:24.562566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:24.648743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1040/2083] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:24.665368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:24.667406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:24.774794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d00262-56dc-49f7-b00d-4663422b707b service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:24.783367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee920a5a-f80c-47aa-ac56-bd70be47647b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:24.784305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920a5a-f80c-47aa-ac56-bd70be47647b service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:24.784677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920a5a-f80c-47aa-ac56-bd70be47647b service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:24.785014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee920a5a-f80c-47aa-ac56-bd70be47647b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:24.797036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee920a5a-f80c-47aa-ac56-bd70be47647b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:24.798977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee920a5a-f80c-47aa-ac56-bd70be47647b service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:24.811933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1044/2084] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:24:26.161361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:26.162936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:26.178091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80529a2d-1735-406a-9214-6fe3089f7b77 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:26.183780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:26.184439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:26.184738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:26.185009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] PATH_INFO: `/v3/users/dbf351d15e5c431781efa4f5d91553c7` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:26.186130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf351d15e5c431781efa4f5d91553c7)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:26.188054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:26.204803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:26.258462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf351d15e5c431781efa4f5d91553c7'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:26.270569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf351d15e5c431781efa4f5d91553c7'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:26.271634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf351d15e5c431781efa4f5d91553c7'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:26.286725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf351d15e5c431781efa4f5d91553c7'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:26.287940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf351d15e5c431781efa4f5d91553c7'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:26.302930 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1041/2085] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:26 2022] DELETE /identity/v3/users/dbf351d15e5c431781efa4f5d91553c7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:26.307626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:26.308173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:26.308173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:26.328266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:26.329527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:26.393125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1045/2086] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:26.405023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:26.406677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:26.478876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76975293-69e8-41ff-8198-d03c3954ef10 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:26.483895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc52518-fba6-4a15-877b-4a9dab795747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:26.484745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52518-fba6-4a15-877b-4a9dab795747 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:26.485197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52518-fba6-4a15-877b-4a9dab795747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:26.485643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc52518-fba6-4a15-877b-4a9dab795747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:26.496228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc52518-fba6-4a15-877b-4a9dab795747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:26.497731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc52518-fba6-4a15-877b-4a9dab795747 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:26.508827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1042/2087] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:26.836771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:26.838331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:26.860048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccddc9ab-c393-488a-bd55-6b6db69e2a64 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:26.869294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:26.870232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:26.870660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:26.871071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] PATH_INFO: `/v3/projects/233a77c7bc4b4625aeda513d92c6fb87` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:26.872549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233a77c7bc4b4625aeda513d92c6fb87)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:26.875287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:26.965033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec140-9a0d-4d7f-be5b-c1765c70ddef None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:26.965533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec140-9a0d-4d7f-be5b-c1765c70ddef None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:26.965973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec140-9a0d-4d7f-be5b-c1765c70ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:26.981834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233a77c7bc4b4625aeda513d92c6fb87', 'request_id': 'req-d549b180-6e99-4217-ba26-b1eef49a00b5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:26.983415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:26.986006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4c6ec140-9a0d-4d7f-be5b-c1765c70ddef None None] MFA Rules not processed for user `b6717f94a3844d1b82817e0f4adcebad`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:26.987368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4c6ec140-9a0d-4d7f-be5b-c1765c70ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:26.991238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233a77c7bc4b4625aeda513d92c6fb87', 'request_id': 'req-d549b180-6e99-4217-ba26-b1eef49a00b5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:27.001513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233a77c7bc4b4625aeda513d92c6fb87', 'request_id': 'req-d549b180-6e99-4217-ba26-b1eef49a00b5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:27.020215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] The token cache is being invalidate because project 233a77c7bc4b4625aeda513d92c6fb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:27.020830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:27.021819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d549b180-6e99-4217-ba26-b1eef49a00b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:27.027197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1046/2088] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:26 2022] DELETE /identity/v3/projects/233a77c7bc4b4625aeda513d92c6fb87 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:27.034319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.034749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.035085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.060151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:27.061606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:27.105706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1043/2089] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:27.164557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1047/2090] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:27.167237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.167708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.167790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.202443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:27.204845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:27.214641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1044/2091] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:27.219395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.232279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c828f4-faea-4751-b85c-2c3ad71bb721 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.238035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.239254 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.239539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.239813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.241107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:24:27.241421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.244242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.262749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1048/2092] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:24:27.267154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.287538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf4b82-3f25-4f2f-b99f-363daa155677 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.308577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.310236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.310623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.312371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.321074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.329686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.407738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1045/2093] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:27 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:27.411882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.431107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711052-4b96-4eb5-a2af-ee96ad25ce37 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.503672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.505232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.505772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.506267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.507124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.510193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.548959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1049/2094] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:27 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:24:27.550668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.565192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705c044-92c8-4313-bd31-0255606e1807 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.580372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.581303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.581582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.581855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.582511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.584125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.585782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:27.599917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1046/2095] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:27.603183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.614656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0367c-68c8-4bd4-ba41-1061c1d65669 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.620343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce8c74-30ac-42f3-8a1f-19983e6c6ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.621053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8c74-30ac-42f3-8a1f-19983e6c6ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.621385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8c74-30ac-42f3-8a1f-19983e6c6ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.621713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce8c74-30ac-42f3-8a1f-19983e6c6ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.622416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce8c74-30ac-42f3-8a1f-19983e6c6ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.624159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce8c74-30ac-42f3-8a1f-19983e6c6ca3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.636411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1050/2096] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:27.641477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.652022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f160f1-072a-4eea-98de-92ea1cb3f4bd admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.658522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.659226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.659505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.659772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] PATH_INFO: `/v3/projects/c28805a02f9b4299bde7677daf760b8a/users/422caca131fe42c6b9080a3dc90c5b38/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.676034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28805a02f9b4299bde7677daf760b8a, user_id=422caca131fe42c6b9080a3dc90c5b38, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.678744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.697439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1047/2097] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:27 2022] PUT /identity/v3/projects/c28805a02f9b4299bde7677daf760b8a/users/422caca131fe42c6b9080a3dc90c5b38/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:27.707692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.708009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.708253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.742292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] MFA Rules not processed for user `422caca131fe42c6b9080a3dc90c5b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:27.743820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:27.785105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:27.832844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1051/2098] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:27.847654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:27.849550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:27.934808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118b863-474a-401d-98ac-152e7ce2d7c1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:27.938790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d5afd-e2df-4758-981f-c911b0dd9370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:27.939566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5afd-e2df-4758-981f-c911b0dd9370 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:27.939907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5afd-e2df-4758-981f-c911b0dd9370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:27.940287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d5afd-e2df-4758-981f-c911b0dd9370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:27.950971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5afd-e2df-4758-981f-c911b0dd9370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:27.952897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d5afd-e2df-4758-981f-c911b0dd9370 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:27.968699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1048/2099] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:27.999597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:28.068367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b2315-dfd2-4583-ac8a-2d766409bc65 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:28.076870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:28.077527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.077872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.078056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] PATH_INFO: `/v3/users/422caca131fe42c6b9080a3dc90c5b38` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.079191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422caca131fe42c6b9080a3dc90c5b38)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:28.081154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:28.143082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422caca131fe42c6b9080a3dc90c5b38'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.153231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422caca131fe42c6b9080a3dc90c5b38'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.161651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422caca131fe42c6b9080a3dc90c5b38'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.163212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422caca131fe42c6b9080a3dc90c5b38'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.178014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422caca131fe42c6b9080a3dc90c5b38'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.185872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1052/2100] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:27 2022] DELETE /identity/v3/users/422caca131fe42c6b9080a3dc90c5b38 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:28.190391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.191343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.191557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.211776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:28.213182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:28.280494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1049/2101] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:28.291402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:28.292962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:28.362250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01edb7b-95b6-4f73-a479-78818b5971e6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:28.366645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf3bd-1e8d-41ff-8620-a998c2341d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:28.367537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf3bd-1e8d-41ff-8620-a998c2341d04 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.367817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf3bd-1e8d-41ff-8620-a998c2341d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.368084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf3bd-1e8d-41ff-8620-a998c2341d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.375986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:28.379167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf3bd-1e8d-41ff-8620-a998c2341d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:28.380786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf3bd-1e8d-41ff-8620-a998c2341d04 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:28.393816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1053/2102] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:28.679915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:28.681502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:28.694283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257c331-0e6b-402f-83d0-36eff369edb2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:28.707318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:28.708032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.708338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.708812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] PATH_INFO: `/v3/projects/c28805a02f9b4299bde7677daf760b8a` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.710043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28805a02f9b4299bde7677daf760b8a)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:28.712949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:28.766374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28805a02f9b4299bde7677daf760b8a', 'request_id': 'req-190bf78e-aec7-4b93-9071-cc9b14cf8799'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.772458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28805a02f9b4299bde7677daf760b8a', 'request_id': 'req-190bf78e-aec7-4b93-9071-cc9b14cf8799'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.779685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28805a02f9b4299bde7677daf760b8a', 'request_id': 'req-190bf78e-aec7-4b93-9071-cc9b14cf8799'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.790535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:28.794387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] The token cache is being invalidate because project c28805a02f9b4299bde7677daf760b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:28.795086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.796139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-190bf78e-aec7-4b93-9071-cc9b14cf8799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:28.797781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1050/2103] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:28 2022] DELETE /identity/v3/projects/c28805a02f9b4299bde7677daf760b8a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:28.802804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.803297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.803401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.824429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:28.825678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:28.884522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1054/2104] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:28.893670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.893978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.894251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.915151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:28.916341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:28.924133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1051/2105] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:28.930496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:28.940659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be15b9-c5b7-4d3d-8676-9dc94d1a6fcf None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:28.946035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:28.946620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.946893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.947159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.947796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:24:28.948089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:28.949714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:28.961438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1055/2106] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:24:28.966119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:28.976083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048803a1-d891-4a71-a18f-1f70d320f8e8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:28.982298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:28.982924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:28.983196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:28.983442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:28.984064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:28.985993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:29.016691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1052/2107] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:28 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:29.021023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:29.034711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442960-9ae8-4bcb-ba83-c215561d2c07 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:29.095303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:29.095986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:29.096452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:29.096674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:29.097302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:29.099226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:29.132207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1056/2108] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:29 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:29.133714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:29.145148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac46e9-badc-4e79-a868-f1d28b41ceb9 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:29.150325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:29.150917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:29.151189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:29.151428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:29.152058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:29.153681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:29.164760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1053/2109] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:24:29.168774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:29.178980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7b7c3-804e-4a4e-9f81-3fef096e99f6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:29.183951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e9452-fb6d-4569-bb03-e144512a7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:29.184572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9452-fb6d-4569-bb03-e144512a7cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:29.184827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9452-fb6d-4569-bb03-e144512a7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:29.185089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e9452-fb6d-4569-bb03-e144512a7cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:29.185721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9452-fb6d-4569-bb03-e144512a7cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:29.187302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e9452-fb6d-4569-bb03-e144512a7cb6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:29.198773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1057/2110] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:29.204230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:29.217257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1772eeb-5552-4903-8057-bf0150e70a42 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:29.222923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:29.223573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:29.223848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:29.224115 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] PATH_INFO: `/v3/projects/125ff55150f6403ba0bccb148121a688/users/483f96224f6040a98940f769e30d0e60/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:29.241229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125ff55150f6403ba0bccb148121a688, user_id=483f96224f6040a98940f769e30d0e60, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:29.244117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:29.259741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1054/2111] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:29 2022] PUT /identity/v3/projects/125ff55150f6403ba0bccb148121a688/users/483f96224f6040a98940f769e30d0e60/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:29.264901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b71a-3aae-4461-868f-f897d0bfeb4c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:29.265186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b71a-3aae-4461-868f-f897d0bfeb4c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:29.265452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f886b71a-3aae-4461-868f-f897d0bfeb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:29.288220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f886b71a-3aae-4461-868f-f897d0bfeb4c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:29.291300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f886b71a-3aae-4461-868f-f897d0bfeb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:29.353710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1058/2112] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:29.363382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:29.365196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:29.428671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9ee89-282f-4d15-9a31-d0d326132cf0 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:29.432866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:29.433481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:29.434314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:29.434574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:29.444602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:29.446120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:29.456857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1055/2113] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:34.163053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.164212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.164608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.172727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:34.206969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] MFA Rules not processed for user `483f96224f6040a98940f769e30d0e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:34.211599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:34.315105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1059/2114] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:34.320087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:34.329972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52cfbc-4da0-4fc1-9793-9339781b304a service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:34.334624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:34.335241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.335639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.335909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.336578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:34.338525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:34.372198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1056/2115] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:34 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:24:34.376618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:34.388328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a1498-0ccb-4c1f-93bb-d52207346f48 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:34.448165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:34.448826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.449104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.449377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.450032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:34.451979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:34.479831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1060/2116] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:34 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:34.480717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:34.493670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6e88a-1eb1-4974-9f36-02ae7b617f11 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:34.498497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:34.499108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.499383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.499648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.500293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:34.501942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:34.514944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1057/2117] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:34.519204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:34.529590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53723a55-ecf1-4ed9-905d-dfd7f37f47d9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:34.534837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:34.535536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.535809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.536077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] PATH_INFO: `/v3/projects/6876493bb4fe400aac8d738ce015d33b/users/8a44377bee0d4b9db8e645532aca076e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.552516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6876493bb4fe400aac8d738ce015d33b, user_id=8a44377bee0d4b9db8e645532aca076e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:34.555356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:34.570450 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1061/2118] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:34 2022] PUT /identity/v3/projects/6876493bb4fe400aac8d738ce015d33b/users/8a44377bee0d4b9db8e645532aca076e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:34.574652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:34.584862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874db707-29e7-40a2-bef4-3a164c31e1fc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:34.644313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:34.645014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.645462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.645765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.646471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:34.648235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:34.654496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:34.660735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1058/2119] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:34.665157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:34.676008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e17e3-3bc3-4545-ac94-9d7c22d02ba0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:34.680872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e880-72c0-4d8a-a97b-7d21367c4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:34.681540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e880-72c0-4d8a-a97b-7d21367c4f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:34.681814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e880-72c0-4d8a-a97b-7d21367c4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:34.682083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e880-72c0-4d8a-a97b-7d21367c4f4d admin admin] PATH_INFO: `/v3/projects/6876493bb4fe400aac8d738ce015d33b/users/8a44377bee0d4b9db8e645532aca076e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:34.683990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e880-72c0-4d8a-a97b-7d21367c4f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6876493bb4fe400aac8d738ce015d33b, user_id=8a44377bee0d4b9db8e645532aca076e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:34.686656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e880-72c0-4d8a-a97b-7d21367c4f4d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:34.697712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1062/2120] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:34 2022] PUT /identity/v3/projects/6876493bb4fe400aac8d738ce015d33b/users/8a44377bee0d4b9db8e645532aca076e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:38.468373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:38.470593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:38.499376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b2102-5995-4736-8c14-fc3de372ce2c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:38.635865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:38.636573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:38.636872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:38.640631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] PATH_INFO: `/v3/users/75d444724101404aae3b395b1ad5ec87` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:38.642167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d444724101404aae3b395b1ad5ec87)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:38.644593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:38.715900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d444724101404aae3b395b1ad5ec87'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:38.737920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d444724101404aae3b395b1ad5ec87'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:38.739912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d444724101404aae3b395b1ad5ec87'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:38.777211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d444724101404aae3b395b1ad5ec87'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:38.778427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d444724101404aae3b395b1ad5ec87'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:38.808749 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1059/2121] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:38 2022] DELETE /identity/v3/users/75d444724101404aae3b395b1ad5ec87 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:38.812890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:38.813337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:38.813453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:38.840626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:38.842608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:38.890920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:38.916912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1063/2122] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:38.931911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:38.933647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:39.039390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85bff9-3228-465b-b65b-a6a8477239ba admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:39.048110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:39.049455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:39.050215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:39.050634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:39.086870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:39.089024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:39.115811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1060/2123] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:40.012149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:40.014612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:40.046191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f845b7e-ec61-4a8d-ac5b-9237530d4fe1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:40.055508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:40.056514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:40.056773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:40.057323 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] PATH_INFO: `/v3/projects/eec5b8913a8f4a338fff60356469f260` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:40.059415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec5b8913a8f4a338fff60356469f260)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:40.063937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:40.197934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec5b8913a8f4a338fff60356469f260', 'request_id': 'req-0e5a5904-839d-42ea-90d9-8a99a4f70b80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.206628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec5b8913a8f4a338fff60356469f260', 'request_id': 'req-0e5a5904-839d-42ea-90d9-8a99a4f70b80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.216579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec5b8913a8f4a338fff60356469f260', 'request_id': 'req-0e5a5904-839d-42ea-90d9-8a99a4f70b80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.234287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] The token cache is being invalidate because project eec5b8913a8f4a338fff60356469f260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:40.234984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.236109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e5a5904-839d-42ea-90d9-8a99a4f70b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.237963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1064/2124] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:40 2022] DELETE /identity/v3/projects/eec5b8913a8f4a338fff60356469f260 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:40.242359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:40.259854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a85c4-f70b-4fa8-ba16-3154c0939d5a service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:40.316657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:40.399556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:40.400654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:40.401168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:40.401692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] PATH_INFO: `/v3/users/fbe05df4c48d4738817d499868606d6d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:40.403872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe05df4c48d4738817d499868606d6d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:40.408591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:40.545621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe05df4c48d4738817d499868606d6d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.572893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe05df4c48d4738817d499868606d6d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.573689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe05df4c48d4738817d499868606d6d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.590255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe05df4c48d4738817d499868606d6d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.591877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe05df4c48d4738817d499868606d6d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:40.613788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1061/2125] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:40 2022] DELETE /identity/v3/users/fbe05df4c48d4738817d499868606d6d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:40.642070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:40.642353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:40.642631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:40.681580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] MFA Rules not processed for user `8a44377bee0d4b9db8e645532aca076e`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:40.683250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:40.836962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1065/2126] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:40.844227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:40.845828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.022343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e04c9-c1bd-43a0-aa1b-8be7596babfc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.032012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.032801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.033210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.033894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.040769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.142082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:41.146554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.153029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f6c73-10ef-4e77-b54d-63f9acbab9a7 service glance] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.170083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1062/2127] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:41.184928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.186458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.347414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:41.371396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee3cdb-a0fb-4611-9e50-02304c67364e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.376586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.377691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.377897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.378196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] PATH_INFO: `/v3/projects/9ac9c7cd1c514faba8e96ff701616300` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.382016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac9c7cd1c514faba8e96ff701616300)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.384503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.391781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.392336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.394948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.424065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:41.426219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.449006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac9c7cd1c514faba8e96ff701616300', 'request_id': 'req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:41.455214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac9c7cd1c514faba8e96ff701616300', 'request_id': 'req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:41.463610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac9c7cd1c514faba8e96ff701616300', 'request_id': 'req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:41.486147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] The token cache is being invalidate because project 9ac9c7cd1c514faba8e96ff701616300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:41.486435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:41.487298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e3202f3e-fb26-4fde-8d19-3c910f8d3fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:41.489290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1066/2128] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:41 2022] DELETE /identity/v3/projects/9ac9c7cd1c514faba8e96ff701616300 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:41.494134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f1f0-2305-49fd-9462-386e64694ac2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.494134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f1f0-2305-49fd-9462-386e64694ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.494399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8f1f0-2305-49fd-9462-386e64694ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.514653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1063/2129] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:41.523790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-89c8f1f0-2305-49fd-9462-386e64694ac2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:41.525375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-89c8f1f0-2305-49fd-9462-386e64694ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.570812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.574609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.604239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1067/2130] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:41.611861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.612287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.612607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.635165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:41.637064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:41.646093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1068/2131] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:41.650931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.660047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd3ad-fc7f-4bd8-9cae-51ea0d608ae9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.661638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95c9b5-2d79-4853-892b-09412d29d7e7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.668346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.669156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.669418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.669967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.670320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:24:41.671056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.672959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.690714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1069/2132] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:24:41.696218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.707766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62ad57-5468-4109-ba33-26bdfa6c83cc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.714141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.714666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.715028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.715548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.716128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.718710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.754928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.756045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.756521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.756786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.761238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1070/2133] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:41 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:24:41.762305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.816266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:41.820169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:41.838643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.840355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.841686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16f19d-4b46-48ac-92fc-5194ca2fc5cb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.846841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.847540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.847877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.848209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.848968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.849430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1064/2134] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:24:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:41.851508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.881624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1071/2135] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:41 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:41.886123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.906397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8814b6-dba3-4306-aae8-13fe28f4643f service swift] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.914253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.914970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.915230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.915875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.916809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.922432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.938901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1065/2136] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:41.939785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:41.954364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0933d-3907-4bc1-82c5-cd5db3b94af7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:41.965367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f073f-c439-4b2e-a052-910649419dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:41.966347 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f073f-c439-4b2e-a052-910649419dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:41.966711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f073f-c439-4b2e-a052-910649419dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:41.967044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f073f-c439-4b2e-a052-910649419dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:41.967711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f073f-c439-4b2e-a052-910649419dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:41.969839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f073f-c439-4b2e-a052-910649419dcf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:41.996482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1072/2137] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:24:41.998346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.013456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62e2ec-202d-4bce-9e8b-c061ef37f9ae admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.022233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.023243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.023525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.023798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] PATH_INFO: `/v3/projects/9b2f7e70fd634f3c9c7796ddefbf2633/users/460757ca6f2a42af9efd9661840fc3cd/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.048306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2f7e70fd634f3c9c7796ddefbf2633, user_id=460757ca6f2a42af9efd9661840fc3cd, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.051038 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.071411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1066/2138] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:41 2022] PUT /identity/v3/projects/9b2f7e70fd634f3c9c7796ddefbf2633/users/460757ca6f2a42af9efd9661840fc3cd/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:42.081992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.082276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.082545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.115431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] MFA Rules not processed for user `460757ca6f2a42af9efd9661840fc3cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:42.116717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:42.221841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1073/2139] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:42.233035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.311624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b273d10-9a33-4ffb-8475-63eae9b20538 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.319199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.320403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.320403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.320649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.321339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.323525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.370125 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1067/2140] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:42 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:42.374105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.393458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389126c-5c54-415e-be7d-b77f66f90c52 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.608787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.609429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.609705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.609971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.610605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.613247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.650732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1074/2141] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:42 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:42.651868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.668409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34794ca1-64c8-404c-afcc-53aaaf542b19 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.676492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.677233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.677618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.678003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.678747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.680571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.696435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1068/2142] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:24:42.700445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.713475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a453a49-baa7-4741-a8fe-13eb1592b6ed admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.719566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.721083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.721631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.722392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] PATH_INFO: `/v3/projects/6c6c33de5b774932adae95a321bd2772/users/e71f97704f30459c9372a7982ad52842/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.741377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6c33de5b774932adae95a321bd2772, user_id=e71f97704f30459c9372a7982ad52842, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.744693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.771889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1075/2143] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:42 2022] PUT /identity/v3/projects/6c6c33de5b774932adae95a321bd2772/users/e71f97704f30459c9372a7982ad52842/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:42.777532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.789554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007af7b6-c495-4855-afb1-3d2f780bb3c4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.892757 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b218eb7-6872-4c5c-96bc-c7353ed65de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.893387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218eb7-6872-4c5c-96bc-c7353ed65de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.894420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218eb7-6872-4c5c-96bc-c7353ed65de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.894700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b218eb7-6872-4c5c-96bc-c7353ed65de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.895354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218eb7-6872-4c5c-96bc-c7353ed65de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.897001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b218eb7-6872-4c5c-96bc-c7353ed65de6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.911375 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1069/2144] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:42.915498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:42.925700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b203a-5a64-45ad-82fe-9acca085e287 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:42.934424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:42.935107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.935383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.935653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] PATH_INFO: `/v3/projects/6c6c33de5b774932adae95a321bd2772/users/e71f97704f30459c9372a7982ad52842/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:42.938675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6c33de5b774932adae95a321bd2772, user_id=e71f97704f30459c9372a7982ad52842, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:42.941366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:42.959811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1076/2145] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:42 2022] PUT /identity/v3/projects/6c6c33de5b774932adae95a321bd2772/users/e71f97704f30459c9372a7982ad52842/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:24:42.971313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:42.971593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:42.971861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.004550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] MFA Rules not processed for user `e71f97704f30459c9372a7982ad52842`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:43.006068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:43.018061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:43.110591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1070/2146] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:43.118144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:43.119910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:43.126234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:43.210192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be18dfa-b335-481a-b1e8-e31ac9b6b9e9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:43.218581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:43.219551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.220162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.220631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.235274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:43.238552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:43.292615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1077/2147] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:43.434428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:43.445934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d72cf-10ea-4135-8bb9-18a6ce342be5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:43.457492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ed0b9-b6ea-490b-a8f6-4edaed4114c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:43.458212 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ed0b9-b6ea-490b-a8f6-4edaed4114c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:43.458557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ed0b9-b6ea-490b-a8f6-4edaed4114c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:43.458911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ed0b9-b6ea-490b-a8f6-4edaed4114c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:43.559781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ed0b9-b6ea-490b-a8f6-4edaed4114c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:43.563721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0ed0b9-b6ea-490b-a8f6-4edaed4114c1 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:43.578618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1071/2148] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:48.742378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:48.821203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262836c6-bce7-4ad3-940f-edb42503b337 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:48.825896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:48.826692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:48.826971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:48.827356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] PATH_INFO: `/v3/users/460757ca6f2a42af9efd9661840fc3cd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:48.828608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=460757ca6f2a42af9efd9661840fc3cd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:48.833200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:48.891555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460757ca6f2a42af9efd9661840fc3cd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:48.906110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460757ca6f2a42af9efd9661840fc3cd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:48.917657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460757ca6f2a42af9efd9661840fc3cd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:48.918681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460757ca6f2a42af9efd9661840fc3cd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:48.931829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460757ca6f2a42af9efd9661840fc3cd'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:48.941570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1078/2149] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:48 2022] DELETE /identity/v3/users/460757ca6f2a42af9efd9661840fc3cd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:48.945331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:48.945906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:48.945997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:48.968293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:48.969769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:49.072507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1072/2150] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:49.082936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:49.084502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:49.127339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:49.178243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778f7bb-20c3-464a-9efe-ba5edd435e6f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:49.185979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:49.186895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:49.187369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:49.187640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:49.199747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:49.202705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:49.221212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1079/2151] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:49.612977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:49.615432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:49.637490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a480fb-1717-44e9-9426-5204eb447fed None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:49.647594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:49.648424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:49.648611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:49.648933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] PATH_INFO: `/v3/projects/9b2f7e70fd634f3c9c7796ddefbf2633` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:49.652586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2f7e70fd634f3c9c7796ddefbf2633)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:49.654533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:49.709439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:49.719857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2f7e70fd634f3c9c7796ddefbf2633', 'request_id': 'req-cbb2c1be-58ec-4400-ac14-45922423b46f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.725737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2f7e70fd634f3c9c7796ddefbf2633', 'request_id': 'req-cbb2c1be-58ec-4400-ac14-45922423b46f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.733594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2f7e70fd634f3c9c7796ddefbf2633', 'request_id': 'req-cbb2c1be-58ec-4400-ac14-45922423b46f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.753133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] The token cache is being invalidate because project 9b2f7e70fd634f3c9c7796ddefbf2633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:49.753580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.754312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.767181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1073/2152] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:49 2022] DELETE /identity/v3/projects/9b2f7e70fd634f3c9c7796ddefbf2633 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:49.767935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:49.781375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4925568-e594-4e8a-ab55-779d90d802b5 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:49.851278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:49.852021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:49.852367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:49.852750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] PATH_INFO: `/v3/users/e71f97704f30459c9372a7982ad52842` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:49.854116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71f97704f30459c9372a7982ad52842)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:49.856897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:49.920030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71f97704f30459c9372a7982ad52842'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.929498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71f97704f30459c9372a7982ad52842'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.938223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71f97704f30459c9372a7982ad52842'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.939172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71f97704f30459c9372a7982ad52842'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.953259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cdfdf06c-a318-487d-b9ec-de84ee13d7d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71f97704f30459c9372a7982ad52842'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:49.962065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1080/2153] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:49 2022] DELETE /identity/v3/users/e71f97704f30459c9372a7982ad52842 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:50.301356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:50.302907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:50.351053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2c1be-58ec-4400-ac14-45922423b46f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:50.439819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:50.440714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:50.441145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:50.441505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] PATH_INFO: `/v3/projects/6c6c33de5b774932adae95a321bd2772` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:50.442772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6c33de5b774932adae95a321bd2772)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:50.445037 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:50.508618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6c33de5b774932adae95a321bd2772', 'request_id': 'req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:50.515538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6c33de5b774932adae95a321bd2772', 'request_id': 'req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:50.522702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6c33de5b774932adae95a321bd2772', 'request_id': 'req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:50.542906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] The token cache is being invalidate because project 6c6c33de5b774932adae95a321bd2772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:50.543249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:50.543896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-38a54ffd-e4a9-46db-b92c-9900b7eb43e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:50.545816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1074/2154] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:50 2022] DELETE /identity/v3/projects/6c6c33de5b774932adae95a321bd2772 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:50.554860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:50.555349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:50.555779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:50.626403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:50.628271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:50.683081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:50.705410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1081/2155] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:50.713902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:50.728681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:50.728995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:50.762944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:50.764157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:50.774343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1075/2156] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:50.778702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:50.791017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8325638b-fb96-4051-8b1d-9471204b0d87 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:50.800980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:50.803085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:50.804129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:50.804650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:50.805678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:24:50.806221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:50.808501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:50.828191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1082/2157] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:24:50.832510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:50.842344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371338b-bcf9-49b7-be08-a17b06191a8c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:50.848836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:50.849464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:50.849737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:50.850015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:50.850873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:50.852854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:50.896027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1076/2158] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:50 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:50.902037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:50.917891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa14b7-d731-403c-827f-aec9fc7e74df admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:51.022456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:51.024043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:51.024608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:51.024912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:51.025557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:51.028951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:51.062853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1083/2159] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:50 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:51.067288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:51.080141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6b85-d03a-4d9c-8e0d-4290e4c14c1b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:51.085726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:51.086466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:51.086798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:51.087139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:51.087848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:51.089553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:51.108030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1077/2160] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:24:51.109482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:51.125312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743e42c-ca25-40c2-9766-71cb186538fd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:51.131256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88117b6f-820f-4f35-b4a9-dd06eb0fbe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:51.131999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88117b6f-820f-4f35-b4a9-dd06eb0fbe37 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:51.132568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88117b6f-820f-4f35-b4a9-dd06eb0fbe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:51.133191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88117b6f-820f-4f35-b4a9-dd06eb0fbe37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:51.134371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88117b6f-820f-4f35-b4a9-dd06eb0fbe37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:51.136818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88117b6f-820f-4f35-b4a9-dd06eb0fbe37 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:51.158956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1084/2161] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:51.160526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:51.183456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23524662-6f41-4407-8293-43b159e53586 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:51.188641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:51.189611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:51.195829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:51.196301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] PATH_INFO: `/v3/projects/cd567b9523524c139d388a0e508eb86a/users/ffc0baddefe842a3bf84a56079dd0a80/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:51.226633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd567b9523524c139d388a0e508eb86a, user_id=ffc0baddefe842a3bf84a56079dd0a80, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:51.232887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:51.235818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:51.259870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1078/2162] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:51 2022] PUT /identity/v3/projects/cd567b9523524c139d388a0e508eb86a/users/ffc0baddefe842a3bf84a56079dd0a80/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:51.265052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5ce1-38b7-452a-aa4d-4f5c46424dec None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:51.265627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5ce1-38b7-452a-aa4d-4f5c46424dec None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:51.266120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5ce1-38b7-452a-aa4d-4f5c46424dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:51.304863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9b3b5ce1-38b7-452a-aa4d-4f5c46424dec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:51.308552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9b3b5ce1-38b7-452a-aa4d-4f5c46424dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:51.426715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1085/2163] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:24:51.437841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:51.440077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:51.585314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f27dd9-a2e1-4660-a2f8-536382eb3188 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:51.589977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:51.590676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:51.590990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:51.591293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:51.607700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:51.609241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:51.628599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1079/2164] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:52.614283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6b94a-6de5-49cd-8568-910ab622be02 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:52.614927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6b94a-6de5-49cd-8568-910ab622be02 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:52.614927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6b94a-6de5-49cd-8568-910ab622be02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:52.622768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:52.625683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:52.654397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dcd0b-b6e1-4d20-ab4b-f37629e0cc55 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:52.674320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-12d6b94a-6de5-49cd-8568-910ab622be02 None None] MFA Rules not processed for user `ffc0baddefe842a3bf84a56079dd0a80`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:52.675555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-12d6b94a-6de5-49cd-8568-910ab622be02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:52.679913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:52.680804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:52.681226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:52.681628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] PATH_INFO: `/v3/users/08be51fe2f1e4a3ab8c926670e3e9d51` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:52.683455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08be51fe2f1e4a3ab8c926670e3e9d51)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:52.686741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:52.760100 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:52.778659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08be51fe2f1e4a3ab8c926670e3e9d51'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:52.793840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08be51fe2f1e4a3ab8c926670e3e9d51'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:52.795155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08be51fe2f1e4a3ab8c926670e3e9d51'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:52.818049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08be51fe2f1e4a3ab8c926670e3e9d51'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:52.819054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08be51fe2f1e4a3ab8c926670e3e9d51'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:52.825442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1086/2165] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:52.830392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03737-196b-4971-b602-50526e61d914 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:52.832823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03737-196b-4971-b602-50526e61d914 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:52.833215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b03737-196b-4971-b602-50526e61d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:52.836726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1080/2166] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:24:52 2022] DELETE /identity/v3/users/08be51fe2f1e4a3ab8c926670e3e9d51 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:52.839709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:52.840441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:52.855582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-82b03737-196b-4971-b602-50526e61d914 None None] MFA Rules not processed for user `483f96224f6040a98940f769e30d0e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:52.856993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-82b03737-196b-4971-b602-50526e61d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:52.922522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e806b-4c78-462c-a8da-bb8aa26778eb admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:52.927512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:52.928215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:52.928584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:52.928983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:52.930044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:52.930361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1087/2167] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:52.932073 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:52.932439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:52.932772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:52.946784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:52.959011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:52.960770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:52.971079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1088/2168] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:52.980401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:52.983003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:52.985527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:53.014866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1081/2169] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:52 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:53.016935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:53.080315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d926-c8ad-4e7a-b78d-d27800247c31 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.134960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949b890-afc5-47b1-82ae-8e44d352200f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.142954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.143570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.143842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.144091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.144326 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.145408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.145908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.146614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.148188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.150442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.155408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.157038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.173934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1089/2170] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:24:53.181066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1082/2171] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:53 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:53.186005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:53.199718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f98a43-6f84-4ba4-a8b4-8c965eafd89c service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.207984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.209556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.210001 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.210335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.211061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.212833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.231435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1090/2172] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:53.239361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:53.257109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cdb8-9a7e-469b-beef-df5ee43af481 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.265646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.269194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.269822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.270300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] PATH_INFO: `/v3/projects/726b62e6fba84f358c0e05dd34e30b95/users/f8e126d50c244c4dba6666b5cbe86a99/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.321443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=726b62e6fba84f358c0e05dd34e30b95, user_id=f8e126d50c244c4dba6666b5cbe86a99, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.324258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.354432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1083/2173] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:53 2022] PUT /identity/v3/projects/726b62e6fba84f358c0e05dd34e30b95/users/f8e126d50c244c4dba6666b5cbe86a99/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:53.355687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:53.384889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ad98-fdb6-4786-a57f-f3804856423c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.429820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:53.472821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.473669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.474056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.474653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.476572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.482056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.498011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1091/2174] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:24:53.498241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:53.510251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3a180-bcf2-4e89-b344-287ff09c45cd admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.517511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feaad31-00c0-4471-9b50-2cb6461d1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.519656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feaad31-00c0-4471-9b50-2cb6461d1d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.519921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feaad31-00c0-4471-9b50-2cb6461d1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.520256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feaad31-00c0-4471-9b50-2cb6461d1d06 admin admin] PATH_INFO: `/v3/projects/726b62e6fba84f358c0e05dd34e30b95/users/f8e126d50c244c4dba6666b5cbe86a99/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.524040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feaad31-00c0-4471-9b50-2cb6461d1d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726b62e6fba84f358c0e05dd34e30b95, user_id=f8e126d50c244c4dba6666b5cbe86a99, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.527808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feaad31-00c0-4471-9b50-2cb6461d1d06 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.543020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1084/2175] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:53 2022] PUT /identity/v3/projects/726b62e6fba84f358c0e05dd34e30b95/users/f8e126d50c244c4dba6666b5cbe86a99/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:24:53.547422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:53.549683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:53.576339 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266239b3-0b01-41a9-9908-c090134fc65e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:53.723318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:53.724199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.724199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.724712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] PATH_INFO: `/v3/projects/c3508b8c833c491592b90ad7e9ed48fc` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.728496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3508b8c833c491592b90ad7e9ed48fc)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:53.730454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:53.818896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3508b8c833c491592b90ad7e9ed48fc', 'request_id': 'req-19315ef0-448a-41a6-8f05-112ef1dd5ef8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:53.827855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3508b8c833c491592b90ad7e9ed48fc', 'request_id': 'req-19315ef0-448a-41a6-8f05-112ef1dd5ef8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:53.855581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3508b8c833c491592b90ad7e9ed48fc', 'request_id': 'req-19315ef0-448a-41a6-8f05-112ef1dd5ef8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:53.903719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] The token cache is being invalidate because project c3508b8c833c491592b90ad7e9ed48fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:24:53.904046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:53.904774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-19315ef0-448a-41a6-8f05-112ef1dd5ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:24:53.906302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1092/2176] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:24:53 2022] DELETE /identity/v3/projects/c3508b8c833c491592b90ad7e9ed48fc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:53.913384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:53.913384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:53.913384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:53.948527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:53.949774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.079751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1085/2177] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:54.089347 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.089715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.090095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.113114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:54.114468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.129702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1093/2178] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:54.134601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.149538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712eb919-6bc9-48a4-bc2d-96595288e82a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.154978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.155708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.156103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.156549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.157230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:24:54.157604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.160179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.192019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1086/2179] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:24:54.192904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.206529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65877c22-2519-4ce3-8fba-7d97f95785c1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.233013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.233639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.233966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.234174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.234808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.237216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.274942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1094/2180] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:24:54 2022] POST /identity/v3/projects => generated 361 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:54.279213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.290168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ac4dc-06ff-4b21-ba97-23eac1393ce6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.329109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:54.377475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.378174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.378454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.378719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.379340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.381346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.415386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1087/2181] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:24:54 2022] POST /identity/v3/users => generated 281 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:24:54.419730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.433708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4681b2-05bc-4f90-9852-c48e8c6fb198 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.439978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.440683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.440966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.441255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.442651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.445277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.459554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1095/2182] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:54.464027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.479987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805694-46b4-474c-b8b8-9538a3089218 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.485756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ffc52-69b8-4941-925e-6cf1b0d136b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.486395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffc52-69b8-4941-925e-6cf1b0d136b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.486672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffc52-69b8-4941-925e-6cf1b0d136b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.486941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ffc52-69b8-4941-925e-6cf1b0d136b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.488254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ffc52-69b8-4941-925e-6cf1b0d136b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.490159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ffc52-69b8-4941-925e-6cf1b0d136b4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.508765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1088/2183] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:24:54.510041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.520889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedb204-2dbd-42f1-be4f-312bdc6c173e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.526479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7682be-0714-4fe3-b9fb-fe7bd8d0ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.527283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7682be-0714-4fe3-b9fb-fe7bd8d0ee97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.527654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7682be-0714-4fe3-b9fb-fe7bd8d0ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.528225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7682be-0714-4fe3-b9fb-fe7bd8d0ee97 admin admin] PATH_INFO: `/v3/projects/9fb790ce421b4d09bf027ed15e990658/users/f0701d6c19594d5292e7223bbe33207a/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.544296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:54.549042 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7682be-0714-4fe3-b9fb-fe7bd8d0ee97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb790ce421b4d09bf027ed15e990658, user_id=f0701d6c19594d5292e7223bbe33207a, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.552781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7682be-0714-4fe3-b9fb-fe7bd8d0ee97 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.573424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1096/2184] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:24:54 2022] PUT /identity/v3/projects/9fb790ce421b4d09bf027ed15e990658/users/f0701d6c19594d5292e7223bbe33207a/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:24:54.584437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.584839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.585114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.618715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.619002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.619373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.620075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] MFA Rules not processed for user `f0701d6c19594d5292e7223bbe33207a`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:54.621361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.651706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] MFA Rules not processed for user `f8e126d50c244c4dba6666b5cbe86a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:54.653015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.697228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1089/2185] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:54.713761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.715949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.759023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1097/2186] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:24:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:54.771713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:54.773708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.794520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803486e-a6b4-44d0-b005-403e3839e55b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.801400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2b6cd-57ed-4e05-8782-9da141f22883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.802296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b6cd-57ed-4e05-8782-9da141f22883 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.802673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b6cd-57ed-4e05-8782-9da141f22883 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.803023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2b6cd-57ed-4e05-8782-9da141f22883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.820691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b6cd-57ed-4e05-8782-9da141f22883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.822183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2b6cd-57ed-4e05-8782-9da141f22883 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.836240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1090/2187] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:54.845296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1b622-44c3-45bc-96da-c59242d67b67 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:54.850716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:54.851453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:54.851640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:54.851910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:54.853738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:54.927345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:54.929477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:54.940241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1098/2188] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:24:56.664673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:56.665239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:56.665239 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:56.686863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:24:56.688587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:56.765797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:56.796572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1091/2189] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:24:56.811750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:56.813996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:24:56.862160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:24:56.906748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a420004-d609-4606-a769-6fba3cd546d4 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:56.911688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:56.912357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:56.912757 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:56.913079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:56.922071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:56.923751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:56.933007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1099/2190] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:24:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:24:57.413019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:24:57.424030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3162d-6a86-419f-a9a0-f7aaa2bb314e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:24:57.428219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf712-3fd1-4183-aeb2-3f6869926e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:24:57.429149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf712-3fd1-4183-aeb2-3f6869926e48 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:24:57.429701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf712-3fd1-4183-aeb2-3f6869926e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:24:57.430072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf712-3fd1-4183-aeb2-3f6869926e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:24:57.442459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf712-3fd1-4183-aeb2-3f6869926e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:24:57.445288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf712-3fd1-4183-aeb2-3f6869926e48 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:24:57.471374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1092/2191] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:24:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:06.929509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=18 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:07.453340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=11 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:17.098190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:17.099872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:17.170523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b6a8-12c0-42cd-ac68-dc354f152821 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:17.177023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:17.177631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:17.177882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:17.178142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:17.180199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:17.192161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:17.193787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:17.203954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1100/2192] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:21.347066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:21.347644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:21.347644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:21.371524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] MFA Rules not processed for user `7dcda8b6ba32416c86b329e2a4ee41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:21.373141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:21.432436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1093/2193] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:23.129645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:23.132134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:23.199956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9116-0eea-446a-a7e3-0739f0536597 service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:23.205796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:23.206452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:23.206813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:23.206993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] PATH_INFO: `/v3/users/ffc0baddefe842a3bf84a56079dd0a80` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:23.208492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffc0baddefe842a3bf84a56079dd0a80)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:23.210468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:23.275819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffc0baddefe842a3bf84a56079dd0a80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.288255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffc0baddefe842a3bf84a56079dd0a80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.304287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffc0baddefe842a3bf84a56079dd0a80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.305512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffc0baddefe842a3bf84a56079dd0a80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.324157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffc0baddefe842a3bf84a56079dd0a80'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.331304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1101/2194] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:25:23 2022] DELETE /identity/v3/users/ffc0baddefe842a3bf84a56079dd0a80 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:23.552841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:23.567728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2cc15-3d33-4e6a-a312-6cc8367de7ea None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:23.659859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:23.660574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:23.660854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:23.661128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] PATH_INFO: `/v3/projects/cd567b9523524c139d388a0e508eb86a` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:23.662894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd567b9523524c139d388a0e508eb86a)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:23.664912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:23.729412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd567b9523524c139d388a0e508eb86a', 'request_id': 'req-b0dc5f61-dcad-4452-bb41-534f1f40e383'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.741830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd567b9523524c139d388a0e508eb86a', 'request_id': 'req-b0dc5f61-dcad-4452-bb41-534f1f40e383'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.762951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd567b9523524c139d388a0e508eb86a', 'request_id': 'req-b0dc5f61-dcad-4452-bb41-534f1f40e383'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.787690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] The token cache is being invalidate because project cd567b9523524c139d388a0e508eb86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:25:23.788333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.789175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:23.791194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1094/2195] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:25:23 2022] DELETE /identity/v3/projects/cd567b9523524c139d388a0e508eb86a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:23.795364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:23.796939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:23.812241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0536b-119c-40b5-9f9c-aef6656d4f21 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:23.817621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:23.899089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:23.900071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:23.900668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:23.900944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] PATH_INFO: `/v3/users/f8e126d50c244c4dba6666b5cbe86a99` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:23.902345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e126d50c244c4dba6666b5cbe86a99)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:23.905915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:23.990058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e126d50c244c4dba6666b5cbe86a99'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.000811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e126d50c244c4dba6666b5cbe86a99'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.013542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e126d50c244c4dba6666b5cbe86a99'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.014738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e126d50c244c4dba6666b5cbe86a99'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.039532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-52baa25a-39b2-45d3-bf81-4b91f1c85556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e126d50c244c4dba6666b5cbe86a99'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.046860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1102/2196] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:25:23 2022] DELETE /identity/v3/users/f8e126d50c244c4dba6666b5cbe86a99 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:25:24.410580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:24.412194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:24.444486 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc5f61-dcad-4452-bb41-534f1f40e383 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:24.484904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:24.524969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:24.525799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:24.526756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:24.527123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] PATH_INFO: `/v3/projects/726b62e6fba84f358c0e05dd34e30b95` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:24.528604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=726b62e6fba84f358c0e05dd34e30b95)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:24.530570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:24.589117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726b62e6fba84f358c0e05dd34e30b95', 'request_id': 'req-0558a113-0605-433f-a8c9-38330301fd6f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.595644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726b62e6fba84f358c0e05dd34e30b95', 'request_id': 'req-0558a113-0605-433f-a8c9-38330301fd6f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.602218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726b62e6fba84f358c0e05dd34e30b95', 'request_id': 'req-0558a113-0605-433f-a8c9-38330301fd6f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.617185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] The token cache is being invalidate because project 726b62e6fba84f358c0e05dd34e30b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:25:24.617484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.618089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0558a113-0605-433f-a8c9-38330301fd6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:24.619687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1095/2197] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:25:24 2022] DELETE /identity/v3/projects/726b62e6fba84f358c0e05dd34e30b95 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:24.625864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:24.626806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:24.630485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:24.651138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:24.653166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:24.718490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1103/2198] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:24.726754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:24.727155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:24.727574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:24.753760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:24.755396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:24.766064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1096/2199] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:24.770358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:24.784471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff02985-ced8-474f-95ae-8b71e97e5d2c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:24.791292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:24.792114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:24.792362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:24.792693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:24.793626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:25:24.794701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:24.796427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:24.809917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1104/2200] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:25:24.814321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:24.823870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d709-b775-4b70-adb0-9efd295aaba6 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:24.829436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:24.830044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:24.830318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:24.830646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:24.831413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:24.833854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:24.868626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1097/2201] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:25:24 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:25:24.874596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:24.891459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a493188-0f65-4079-ae00-be978670e1c9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:24.903699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:24.956195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:24.956835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:24.957187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:24.957509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:24.958190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:24.960158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:24.986272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1105/2202] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:25:24 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:25:24.990465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.001047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b8113-0956-4618-9d78-c8f5ec76e45b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.006251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.006883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.007147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.007401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.008068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.009702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.020051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1098/2203] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:25:25.024283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.037655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d8ef4-5dec-4ef3-b311-501b65c07173 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.044360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc8bba-66c5-426b-ba1a-b457365832f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.045015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8bba-66c5-426b-ba1a-b457365832f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.045587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8bba-66c5-426b-ba1a-b457365832f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.045587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8bba-66c5-426b-ba1a-b457365832f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.046201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc8bba-66c5-426b-ba1a-b457365832f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.047874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc8bba-66c5-426b-ba1a-b457365832f0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.062167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1106/2204] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:25.066151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.078431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eeee2-2ef4-408a-abcc-2ec8a0130889 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.084122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.084950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.085243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.085481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] PATH_INFO: `/v3/projects/31e9d4ccfe25432ba0354de20e2ed5bd/users/f75c3841ea7e464bb786b96a94954206/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.103157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e9d4ccfe25432ba0354de20e2ed5bd, user_id=f75c3841ea7e464bb786b96a94954206, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.106055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.125833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1099/2205] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:25 2022] PUT /identity/v3/projects/31e9d4ccfe25432ba0354de20e2ed5bd/users/f75c3841ea7e464bb786b96a94954206/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:25:25.143744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.143744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.143744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.170933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] MFA Rules not processed for user `f75c3841ea7e464bb786b96a94954206`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:25.172249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:25.245453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1107/2206] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:25.250196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.325274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eed2ce-19be-4971-a759-f07fa49ae05c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.329988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.330599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.330858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.331124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.331764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.333793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.340308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:25.368724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1100/2207] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:25:25 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:25:25.373385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.387462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0fc2b-a25f-46f1-b109-0e11f13bee82 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.457978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.458651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.458912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.459180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.459833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.461763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.490520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1108/2208] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:25:25 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:25:25.491676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.503046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498eb1-a06c-47aa-b9bc-e701cd6c2df4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.507594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.508204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.508563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.508834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.509483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.511167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.522615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1101/2209] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:25:25.528284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.539154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afda3ed-e724-4403-94a2-1aaee868ea84 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.544192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.544921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.545196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.545467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] PATH_INFO: `/v3/projects/09abaea6dcf7479abeb3b1a7ab9b8d31/users/0472613ae59c42c981fd1b61a814e283/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.557184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:25.563264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09abaea6dcf7479abeb3b1a7ab9b8d31, user_id=0472613ae59c42c981fd1b61a814e283, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.566279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.581561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1109/2210] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:25 2022] PUT /identity/v3/projects/09abaea6dcf7479abeb3b1a7ab9b8d31/users/0472613ae59c42c981fd1b61a814e283/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:25.585400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.597082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ad42b-6f8a-4a79-b12b-391f0d2f638c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.663202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780e3d4-0dfb-48dc-8e00-828dec7cba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.663825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e3d4-0dfb-48dc-8e00-828dec7cba3e admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.664089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e3d4-0dfb-48dc-8e00-828dec7cba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.664358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780e3d4-0dfb-48dc-8e00-828dec7cba3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.665048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780e3d4-0dfb-48dc-8e00-828dec7cba3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.666677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780e3d4-0dfb-48dc-8e00-828dec7cba3e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.677244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1102/2211] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:25.681365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.693198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643a6ab-650a-41e7-8d01-689cc8bad9dc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.698406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.699070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.699568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.700291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] PATH_INFO: `/v3/projects/09abaea6dcf7479abeb3b1a7ab9b8d31/users/0472613ae59c42c981fd1b61a814e283/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.702349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09abaea6dcf7479abeb3b1a7ab9b8d31, user_id=0472613ae59c42c981fd1b61a814e283, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.705022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:25.721207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1110/2212] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:25 2022] PUT /identity/v3/projects/09abaea6dcf7479abeb3b1a7ab9b8d31/users/0472613ae59c42c981fd1b61a814e283/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:25.732285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.732630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.732899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.764813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] MFA Rules not processed for user `0472613ae59c42c981fd1b61a814e283`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:25.765995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:25.852194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1103/2213] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:25.863405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:25.865369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:25.928791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f99b3-1ec5-45ef-acc5-a911f73602bc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:25.932372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:25.932994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:25.933265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:25.933549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:25.997720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:25.999444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:26.010711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1111/2214] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:32.447159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:32.448709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:32.462667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa63b0-12de-4f6f-abf0-6b2dc4cc97c6 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:32.467647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10066259-0cbe-431c-a933-3d70a0a76639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:32.468869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066259-0cbe-431c-a933-3d70a0a76639 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:32.469145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066259-0cbe-431c-a933-3d70a0a76639 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:32.469413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10066259-0cbe-431c-a933-3d70a0a76639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:32.480089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10066259-0cbe-431c-a933-3d70a0a76639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:32.481566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10066259-0cbe-431c-a933-3d70a0a76639 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:32.492656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1104/2215] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:36.005810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:37.465156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:37.543068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867689ac-7689-4749-9db6-4deb5f1e7d13 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:37.547746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:37.548370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:37.548698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:37.548906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] PATH_INFO: `/v3/users/f75c3841ea7e464bb786b96a94954206` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:37.550312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75c3841ea7e464bb786b96a94954206)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:37.552267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:37.598948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75c3841ea7e464bb786b96a94954206'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:37.607334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75c3841ea7e464bb786b96a94954206'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:37.614530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75c3841ea7e464bb786b96a94954206'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:37.615166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75c3841ea7e464bb786b96a94954206'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:37.627087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75c3841ea7e464bb786b96a94954206'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:37.633235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1112/2216] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:25:37 2022] DELETE /identity/v3/users/f75c3841ea7e464bb786b96a94954206 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:37.637917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:37.638432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:37.638432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:37.658012 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:37.659260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:37.700714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:37.722389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1105/2217] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:37.732591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:37.734161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:37.793212 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf9e37-5fa9-4274-8b49-6869873b4741 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:37.798848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:37.799548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:37.799820 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:37.800082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:37.809841 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:37.812019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:37.824209 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1113/2218] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:38.179381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:38.180899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:38.198149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45027f05-749d-469e-b88b-a3a24043bf97 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:38.204184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:38.204942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:38.205404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:38.205747 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] PATH_INFO: `/v3/projects/31e9d4ccfe25432ba0354de20e2ed5bd` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:38.207065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e9d4ccfe25432ba0354de20e2ed5bd)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:38.209190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:38.260889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e9d4ccfe25432ba0354de20e2ed5bd', 'request_id': 'req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.266859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e9d4ccfe25432ba0354de20e2ed5bd', 'request_id': 'req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.273455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e9d4ccfe25432ba0354de20e2ed5bd', 'request_id': 'req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.287723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] The token cache is being invalidate because project 31e9d4ccfe25432ba0354de20e2ed5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:25:38.288008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.288647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.290143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1106/2219] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:25:38 2022] DELETE /identity/v3/projects/31e9d4ccfe25432ba0354de20e2ed5bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:38.294198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:38.304242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e568b-f90e-4a66-a101-6413a126b2d2 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:38.322587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:38.364098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:38.364693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:38.364970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:38.365239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] PATH_INFO: `/v3/users/0472613ae59c42c981fd1b61a814e283` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:38.366401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0472613ae59c42c981fd1b61a814e283)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:38.368311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:38.416199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0472613ae59c42c981fd1b61a814e283'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.425161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0472613ae59c42c981fd1b61a814e283'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.432103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0472613ae59c42c981fd1b61a814e283'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.432756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0472613ae59c42c981fd1b61a814e283'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.446193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7face38-c3e9-4b18-8c2a-cfa8ed5c6d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0472613ae59c42c981fd1b61a814e283'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.452691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1114/2220] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:25:38 2022] DELETE /identity/v3/users/0472613ae59c42c981fd1b61a814e283 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:25:38.743654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:38.745252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:38.762440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4a7b3-32dc-4871-8cb6-a63c53e380f5 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:38.834815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:38.835455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:38.835729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:38.835994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] PATH_INFO: `/v3/projects/09abaea6dcf7479abeb3b1a7ab9b8d31` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:38.837150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09abaea6dcf7479abeb3b1a7ab9b8d31)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:38.839101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:38.905546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09abaea6dcf7479abeb3b1a7ab9b8d31', 'request_id': 'req-4ae2f9e5-bc67-447e-a009-b8f2faed2152'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.912424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09abaea6dcf7479abeb3b1a7ab9b8d31', 'request_id': 'req-4ae2f9e5-bc67-447e-a009-b8f2faed2152'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.919573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09abaea6dcf7479abeb3b1a7ab9b8d31', 'request_id': 'req-4ae2f9e5-bc67-447e-a009-b8f2faed2152'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.930469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:38.935909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] The token cache is being invalidate because project 09abaea6dcf7479abeb3b1a7ab9b8d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:25:38.936642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.937713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-4ae2f9e5-bc67-447e-a009-b8f2faed2152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:25:38.940365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1107/2221] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:25:38 2022] DELETE /identity/v3/projects/09abaea6dcf7479abeb3b1a7ab9b8d31 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:25:38.946763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:38.947230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:38.947331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:38.976679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:38.978056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:39.072157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1115/2222] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:39.082845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.083122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.083623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.106546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:39.107824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:39.116776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1108/2223] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:39.121078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.131724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810402c-516a-4594-9963-dab1dd5c3930 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.136238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.136897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.137171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.137431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.138106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:25:39.138400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.140172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.157628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1116/2224] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:25:39.161431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.171632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eded72f-232c-4ae3-b94a-77e61307a525 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.177046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.177733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.178087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.178412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.179093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.181400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.215379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1109/2225] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:25:39 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:25:39.219994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.234535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bde897-6bd9-49ea-afad-0ad2fb3a1ea0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.269962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:39.297637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.301637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:39.317836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.318651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.319175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.319590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.320463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.322994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.353260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1117/2226] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:25:39 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:25:39.358029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.377289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5496b5-ac38-484d-a703-2e10b33a6939 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.379791 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd37e5-148b-477f-afb0-f32af0d201b8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.383612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.384249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.384519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.384643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.384991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.385318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.385659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.385857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.386071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.387842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.388137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:39.405380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1118/2227] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:39.409818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.424961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be839507-186a-4034-9cd9-168b26376f70 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.433211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.433826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.434119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.434894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.435555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.437694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.451321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1119/2228] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:25:39.454826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.465839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5288df-e131-4a8d-b6a1-1f44ff4eb3af admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.472307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.472913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.473735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.474019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.474290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] PATH_INFO: `/v3/projects/8a61ca663df140f3bdd4b2176add22fa/users/7388ea8712b54625904e8e895b88a620/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.476122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac1db-1ed0-46c0-bb2c-5d444e55b4f4 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.487918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1110/2229] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:39.491899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a61ca663df140f3bdd4b2176add22fa, user_id=7388ea8712b54625904e8e895b88a620, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.494878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.514141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1120/2230] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:25:39 2022] PUT /identity/v3/projects/8a61ca663df140f3bdd4b2176add22fa/users/7388ea8712b54625904e8e895b88a620/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:25:39.525887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.526086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.526210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.560795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] MFA Rules not processed for user `7388ea8712b54625904e8e895b88a620`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:25:39.562160 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:39.640087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1111/2231] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:25:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:25:39.654168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:25:39.656056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:25:39.719099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8756be-24c6-4169-81bf-8c6b68ee8e7d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:25:39.724601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97174d50-d396-4354-a235-dd76f66b86fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:25:39.725709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174d50-d396-4354-a235-dd76f66b86fc service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:25:39.725998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174d50-d396-4354-a235-dd76f66b86fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:25:39.726271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97174d50-d396-4354-a235-dd76f66b86fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:25:39.739769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97174d50-d396-4354-a235-dd76f66b86fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:25:39.741617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97174d50-d396-4354-a235-dd76f66b86fc service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:25:39.763398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1121/2232] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:25:49.635215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:25:49.746847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=62,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:08.126072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:08.127878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:08.198277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f6d73-e412-4fe6-90b3-dd569086cd17 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:08.203917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:08.204662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:08.205002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:08.205282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] PATH_INFO: `/v3/users/f0701d6c19594d5292e7223bbe33207a` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:08.206811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0701d6c19594d5292e7223bbe33207a)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:08.209436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:08.263005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0701d6c19594d5292e7223bbe33207a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.271450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0701d6c19594d5292e7223bbe33207a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.272192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0701d6c19594d5292e7223bbe33207a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.283906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0701d6c19594d5292e7223bbe33207a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.284562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0701d6c19594d5292e7223bbe33207a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.297254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1112/2233] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:26:08 2022] DELETE /identity/v3/users/f0701d6c19594d5292e7223bbe33207a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:08.302097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:08.302566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:08.302678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:08.322474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:08.323673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:08.385289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1122/2234] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:08.395340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:08.397020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:08.453774 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39eb25b-9e7b-469f-b518-f5ee7afbb80e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:08.458094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:08.458701 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:08.458974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:08.459270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:08.468951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:08.470390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:08.480118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1113/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:08.780101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:08.781634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:08.797213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfe0f1-da76-4752-a22f-12885fef8416 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:08.802730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:08.804149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:08.804463 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:08.804715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] PATH_INFO: `/v3/projects/9fb790ce421b4d09bf027ed15e990658` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:08.806003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb790ce421b4d09bf027ed15e990658)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:08.807955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:08.857845 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb790ce421b4d09bf027ed15e990658', 'request_id': 'req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.863178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb790ce421b4d09bf027ed15e990658', 'request_id': 'req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.869508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb790ce421b4d09bf027ed15e990658', 'request_id': 'req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.884062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] The token cache is being invalidate because project 9fb790ce421b4d09bf027ed15e990658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:26:08.884349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.885022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0e25f28f-e781-4cc3-b617-3bc9e3ca008c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:08.886807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1123/2236] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:26:08 2022] DELETE /identity/v3/projects/9fb790ce421b4d09bf027ed15e990658 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:09.088933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:09.090512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:09.103609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07570a05-f1e7-442a-b7de-9cbc270e133d service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:09.121716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:09.161369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50341d24-d569-4de0-950e-147214df24db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:09.162028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50341d24-d569-4de0-950e-147214df24db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:09.162261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50341d24-d569-4de0-950e-147214df24db admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:09.162573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50341d24-d569-4de0-950e-147214df24db admin admin] PATH_INFO: `/v3/users/7388ea8712b54625904e8e895b88a620` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:09.163721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50341d24-d569-4de0-950e-147214df24db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7388ea8712b54625904e8e895b88a620)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:09.165691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50341d24-d569-4de0-950e-147214df24db admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:09.221517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7388ea8712b54625904e8e895b88a620'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.230984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7388ea8712b54625904e8e895b88a620'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.231784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7388ea8712b54625904e8e895b88a620'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.243951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7388ea8712b54625904e8e895b88a620'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.244606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7388ea8712b54625904e8e895b88a620'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.258334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1114/2237] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:26:09 2022] DELETE /identity/v3/users/7388ea8712b54625904e8e895b88a620 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:09.262727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:09.263013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:09.263282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:09.283649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:09.284896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:09.344462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1124/2238] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:09.354474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:09.355962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:09.420204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50341d24-d569-4de0-950e-147214df24db admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:09.424414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7595305-d32d-43e2-8992-e1a8fa044a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:09.425023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7595305-d32d-43e2-8992-e1a8fa044a4e service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:09.425280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7595305-d32d-43e2-8992-e1a8fa044a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:09.425547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7595305-d32d-43e2-8992-e1a8fa044a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:09.434967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7595305-d32d-43e2-8992-e1a8fa044a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:09.436405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7595305-d32d-43e2-8992-e1a8fa044a4e service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:09.446002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1115/2239] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:09.747002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:09.748568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:09.765039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ce7c7-f5ef-47cf-9398-ec142d4d2aad None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:09.771264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:09.772925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:09.773257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:09.773543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] PATH_INFO: `/v3/projects/8a61ca663df140f3bdd4b2176add22fa` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:09.775550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a61ca663df140f3bdd4b2176add22fa)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:09.777814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:09.799564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:09.827875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a61ca663df140f3bdd4b2176add22fa', 'request_id': 'req-b67368ae-3b2b-47ee-ae75-4452a3958f78'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.833941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a61ca663df140f3bdd4b2176add22fa', 'request_id': 'req-b67368ae-3b2b-47ee-ae75-4452a3958f78'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.840609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a61ca663df140f3bdd4b2176add22fa', 'request_id': 'req-b67368ae-3b2b-47ee-ae75-4452a3958f78'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.855013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] The token cache is being invalidate because project 8a61ca663df140f3bdd4b2176add22fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:26:09.855304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.855944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b67368ae-3b2b-47ee-ae75-4452a3958f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:26:09.857503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1125/2240] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:26:09 2022] DELETE /identity/v3/projects/8a61ca663df140f3bdd4b2176add22fa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:09.862849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:09.863134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:09.863444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:09.885202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:09.886419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:09.930577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:09.951622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1116/2241] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:09.959827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:09.960112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:09.960410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:09.980980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:09.982205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:09.991699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1126/2242] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:26:09.996064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.006713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381eb3-603e-42c2-b282-fae942a7dc90 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.012522 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.013128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.013406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.013655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.014328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:26:10.014631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.016240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.035710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1117/2243] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:26:10.040548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.050407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673a263-9fd2-4557-b1a1-7297d81001a7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.056427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.057057 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.057333 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.057600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.058220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.060178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.090152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1127/2244] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:26:10 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:26:10.093935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.105619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d159ef-08ac-47a4-bc3b-2ad31e0b1c60 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.166831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.167553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.167668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.167954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.168689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.170600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.192880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1118/2245] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:26:10 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:26:10.197747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.208302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71564968-4528-45ca-8e1b-d5f5eee0f982 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.213920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.214860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.215735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.216012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.216713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.218314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.228190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1128/2246] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:26:10.232231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.242643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa1bf-3138-4c95-af8e-ad71c95ebee5 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.247839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06b00c-bdda-4ed4-a28b-7828387fb64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.248454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b00c-bdda-4ed4-a28b-7828387fb64f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.248732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b00c-bdda-4ed4-a28b-7828387fb64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.248998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b00c-bdda-4ed4-a28b-7828387fb64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.249634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06b00c-bdda-4ed4-a28b-7828387fb64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.251564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06b00c-bdda-4ed4-a28b-7828387fb64f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.262739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1119/2247] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:26:10.267412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.279803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f30543-6a58-43b3-9151-a7d78899a5bb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.285378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.286015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.286288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.286551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] PATH_INFO: `/v3/projects/602ad89c70da4ace9856766be19815a5/users/50fa6727271142eba979bb4562a2b853/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.302842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ad89c70da4ace9856766be19815a5, user_id=50fa6727271142eba979bb4562a2b853, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.305559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.321574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1129/2248] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:26:10 2022] PUT /identity/v3/projects/602ad89c70da4ace9856766be19815a5/users/50fa6727271142eba979bb4562a2b853/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:10.326581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac1e6-8b78-45c3-b2e7-17bf9d2a6f1d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.326857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac1e6-8b78-45c3-b2e7-17bf9d2a6f1d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.327122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ac1e6-8b78-45c3-b2e7-17bf9d2a6f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.347454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a93ac1e6-8b78-45c3-b2e7-17bf9d2a6f1d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:10.348681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a93ac1e6-8b78-45c3-b2e7-17bf9d2a6f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:10.412808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1120/2249] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:10.422332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:10.424154 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:10.485072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490e71a-d0af-48a0-a5d9-3b362d267276 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:10.488704 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:10.489310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:10.489585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:10.489851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:10.499231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:10.501031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:10.510525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1130/2250] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:14.916294 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:14.918163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:14.918892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:14.954732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] MFA Rules not processed for user `50fa6727271142eba979bb4562a2b853`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:14.957022 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:15.005014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:15.033271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1121/2251] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:15.038267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:15.052973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773f2c4-8dcf-4e44-88a4-cd7acb83746d service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:15.059204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:15.059822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:15.060128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:15.060441 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:15.061054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:15.062994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:15.099263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1131/2252] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:26:15.103331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:15.114713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab12913-aaf2-4532-b1b0-147f76c2fd89 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:15.175506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:15.176042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:15.176329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:15.176684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:15.177326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:15.179322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:15.205754 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1122/2253] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:26:15 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:26:15.207089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:15.218713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0707b-b14e-4b06-869c-198d90ae3bac admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:15.223646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:15.224250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:15.225067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:15.225363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:15.226011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:15.227628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:15.238928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1132/2254] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:26:15.243203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:15.254271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f46b8-9856-44c4-99ab-a56811f708e4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:15.259722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:15.260460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:15.260732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:15.260993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] PATH_INFO: `/v3/projects/5f348bffdeba4c2db9b383058a7514e5/users/b5deaba3e7a04688b15ab6ac48ac0a42/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:15.278375 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f348bffdeba4c2db9b383058a7514e5, user_id=b5deaba3e7a04688b15ab6ac48ac0a42, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:15.281079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:15.299786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1123/2255] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:26:15 2022] PUT /identity/v3/projects/5f348bffdeba4c2db9b383058a7514e5/users/b5deaba3e7a04688b15ab6ac48ac0a42/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:15.304170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:15.315902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f742a-d77c-4b0d-9c84-72455656a20c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:15.335283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:15.405891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6f1c7-47ab-446b-8244-b169a0992671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:15.406644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f1c7-47ab-446b-8244-b169a0992671 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:15.407030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f1c7-47ab-446b-8244-b169a0992671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:15.407458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6f1c7-47ab-446b-8244-b169a0992671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:15.408191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6f1c7-47ab-446b-8244-b169a0992671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:15.410034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6f1c7-47ab-446b-8244-b169a0992671 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:15.423168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1133/2256] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:26:15.429580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:15.440735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292ff38-d53f-4308-b067-babfae903d38 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:15.445873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:15.446625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:15.446971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:15.447311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] PATH_INFO: `/v3/projects/5f348bffdeba4c2db9b383058a7514e5/users/b5deaba3e7a04688b15ab6ac48ac0a42/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:15.449374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f348bffdeba4c2db9b383058a7514e5, user_id=b5deaba3e7a04688b15ab6ac48ac0a42, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:15.452164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:15.465411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1124/2257] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:26:15 2022] PUT /identity/v3/projects/5f348bffdeba4c2db9b383058a7514e5/users/b5deaba3e7a04688b15ab6ac48ac0a42/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:26:19.917920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13e7d-0e2c-4693-aee8-88c4ef2d9b56 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:19.918382 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13e7d-0e2c-4693-aee8-88c4ef2d9b56 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:19.918504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d13e7d-0e2c-4693-aee8-88c4ef2d9b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:19.950522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-66d13e7d-0e2c-4693-aee8-88c4ef2d9b56 None None] MFA Rules not processed for user `b5deaba3e7a04688b15ab6ac48ac0a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:19.951734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-66d13e7d-0e2c-4693-aee8-88c4ef2d9b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:20.072486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1134/2258] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:20.085330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:20.087820 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:20.175905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd85bf-15bd-4142-a758-2ab702e1e8a4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:20.181470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb3b2-2c44-46e4-8016-da362f101733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:20.182093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb3b2-2c44-46e4-8016-da362f101733 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:20.182368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb3b2-2c44-46e4-8016-da362f101733 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:20.182636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb3b2-2c44-46e4-8016-da362f101733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:20.216245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:20.244191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb3b2-2c44-46e4-8016-da362f101733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:20.245840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb3b2-2c44-46e4-8016-da362f101733 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:20.255852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1125/2259] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:30.065177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=57 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:30.251441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=14 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:42.720153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:42.720774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:42.720774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:42.739784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] MFA Rules not processed for user `c8982b93df5744bbbdeb7a956df06502`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:42.741371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:42.806203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1135/2260] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:47.271380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:47.271950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:47.271950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:47.291948 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] MFA Rules not processed for user `50fa6727271142eba979bb4562a2b853`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:26:47.293206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:47.301481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1126/2261] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:26:52.798950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=25 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:26:55.548703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:55.605862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa67d4-62c9-4cbf-86a8-d2a706d75c4a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:55.609974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:55.610572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:55.610847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:55.611111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:55.613147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:55.626851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:55.628260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:55.639673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1136/2262] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:26:55.773872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:26:55.783779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110d68d-af51-4f63-bee1-4a6d2ccd086a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:26:55.787508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:26:55.788105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:26:55.788556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:26:55.788668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:26:55.790463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:26:55.807325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:26:55.808806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9898f5cf-ec63-4a8f-ba84-d0a0b88f66fe service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:26:55.820237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1127/2263] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:26:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:05.634275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=26 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:05.815300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=9 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:10.555850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:10.566020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb14ac-2e45-4a6f-bc8a-d567ffbc5f25 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:10.570359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:10.570952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:10.571208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:10.571477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:10.582624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:10.584070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:10.598034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1137/2264] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:20.591913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:25.056836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.057389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.057389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.079229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:25.080634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.155472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1128/2265] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:27:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:25.215447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:25.216995 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.222666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:25.224434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.235857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e021eaa-0eb9-4b52-8c62-5fc99fe19157 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:25.239588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:25.240302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.240700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.241058 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.242961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:25.255005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:25.256678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:25.265742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1129/2266] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:25.296743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06272cd-9338-41d1-91b0-187e902aa430 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:25.301986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:25.302596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:25.302923 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:25.303201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:25.311500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:25.313122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:25.321166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1138/2267] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:27:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:27:35.261411 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=31 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:35.318105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=32 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:36.833364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:36.835027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:36.852333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1e49-995b-402e-93b7-a6f0e2afdebb service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:36.859087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:36.859943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:36.860210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:36.860593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:36.862601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:36.923287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:36.925368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3217fb0-f36f-453a-a011-813ee0ee8b4e service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:36.935300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1130/2268] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:40.690160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:40.700563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733de1b1-c420-4a16-961b-25e3e7520407 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:40.704891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:40.705483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:40.705760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:40.706024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:40.707905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:40.718438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:40.719862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce486f-60ac-4990-93da-0f70b0f1c18b service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:40.728015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1139/2269] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:40.862640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59499a8f-70ff-4257-ac10-e4ac48025e32 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:40.863201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59499a8f-70ff-4257-ac10-e4ac48025e32 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:40.863201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59499a8f-70ff-4257-ac10-e4ac48025e32 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:40.864612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1131/2270] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:27:40.871586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887c07-6aae-49f7-8f72-b67f5f84b6f9 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:40.871754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887c07-6aae-49f7-8f72-b67f5f84b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:40.872041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887c07-6aae-49f7-8f72-b67f5f84b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:40.900469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-cd887c07-6aae-49f7-8f72-b67f5f84b6f9 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:40.901774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-cd887c07-6aae-49f7-8f72-b67f5f84b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:40.912013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1140/2271] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:27:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:27:40.923549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59499a8f-70ff-4257-ac10-e4ac48025e32 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:40.925365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-59499a8f-70ff-4257-ac10-e4ac48025e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:40.998590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59499a8f-70ff-4257-ac10-e4ac48025e32 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:41.003156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215acd9-c39f-4963-a5c7-9191f53c9c29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:41.003847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215acd9-c39f-4963-a5c7-9191f53c9c29 service glance] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.004187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215acd9-c39f-4963-a5c7-9191f53c9c29 service glance] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.004620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215acd9-c39f-4963-a5c7-9191f53c9c29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.017386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215acd9-c39f-4963-a5c7-9191f53c9c29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:41.018830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215acd9-c39f-4963-a5c7-9191f53c9c29 service glance] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:41.029983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1132/2272] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:41.101976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2399-6a8c-479f-8c36-aaf2f5c0c690 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.102290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2399-6a8c-479f-8c36-aaf2f5c0c690 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.102554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2399-6a8c-479f-8c36-aaf2f5c0c690 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.103976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1141/2273] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:27:41.109061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5397-4bef-4e9b-a66c-d631314e9ac0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.109343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5397-4bef-4e9b-a66c-d631314e9ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.109611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f5397-4bef-4e9b-a66c-d631314e9ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.130711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-843f5397-4bef-4e9b-a66c-d631314e9ac0 None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:41.131836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-843f5397-4bef-4e9b-a66c-d631314e9ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:41.139900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1133/2274] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:41.152269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2399-6a8c-479f-8c36-aaf2f5c0c690 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:41.168579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2399-6a8c-479f-8c36-aaf2f5c0c690 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:41.173327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879b73c-0ef5-4dd9-a351-7e9873992fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:41.173934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b73c-0ef5-4dd9-a351-7e9873992fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.174210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b73c-0ef5-4dd9-a351-7e9873992fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.174626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b73c-0ef5-4dd9-a351-7e9873992fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.182695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b73c-0ef5-4dd9-a351-7e9873992fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:41.184405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0879b73c-0ef5-4dd9-a351-7e9873992fe5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:41.192822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1142/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:41.281446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca01b-ef6f-4a49-8d8e-0c3020681db4 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.281816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca01b-ef6f-4a49-8d8e-0c3020681db4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.282157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ca01b-ef6f-4a49-8d8e-0c3020681db4 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.283593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1134/2276] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:27:41.289193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.289490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.289788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.310304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:41.311504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:41.320994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1143/2277] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:41.332246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca01b-ef6f-4a49-8d8e-0c3020681db4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:41.344768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0ca01b-ef6f-4a49-8d8e-0c3020681db4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:41.348673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b38e29-6372-49b8-b3af-2c35513cbc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:41.349276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b38e29-6372-49b8-b3af-2c35513cbc38 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.349552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b38e29-6372-49b8-b3af-2c35513cbc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.349821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b38e29-6372-49b8-b3af-2c35513cbc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.360506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b38e29-6372-49b8-b3af-2c35513cbc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:41.361931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b38e29-6372-49b8-b3af-2c35513cbc38 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:41.372850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1135/2278] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:41.439198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:41.440651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:41.514242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b7631-0a36-4e43-a54f-cf14e7ab15aa None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:41.519311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:41.519926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:41.520197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:41.520495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:41.522241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:41.533771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:41.535352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:41.545671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1144/2279] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:27:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:27:49.143670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bdc66-7187-4788-8004-44d25a5cd8f3 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.144180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bdc66-7187-4788-8004-44d25a5cd8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.144301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bdc66-7187-4788-8004-44d25a5cd8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.164260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-485bdc66-7187-4788-8004-44d25a5cd8f3 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:27:49.165624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-485bdc66-7187-4788-8004-44d25a5cd8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:27:49.173708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1136/2280] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:27:49.186733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:27:49.198104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74544fd9-6f51-4cf5-a97f-5e071c8d5abc service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:27:49.203363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:27:49.204029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:27:49.204308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:27:49.204608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:27:49.213178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:27:49.214751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:27:49.223148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1145/2281] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:27:59.158762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=66 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:27:59.219941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=56 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:12.992490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:12.992953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:12.993043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:13.013335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] MFA Rules not processed for user `7dcda8b6ba32416c86b329e2a4ee41e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:13.014571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:13.022597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1137/2282] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:16.878839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:16.895938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839a337-c72f-40ea-b2f5-93d6199e3c96 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:16.902683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:16.903289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:16.903560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:16.903824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:16.905741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:16.919549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:16.921225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3b0d5-3e98-4af6-b109-3d922f9a5eaa service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:16.932630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1146/2283] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:20.757017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:20.777536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea232ed3-2636-4003-a007-7dd8275ba143 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:20.789164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:20.789797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:20.790067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:20.790330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:20.792181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:20.806225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:20.808785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:20.820399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1138/2284] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:21.673684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:21.674255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:21.674378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:21.700413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:21.701622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:21.709288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1147/2285] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 9 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:28:21.725696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:21.738436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577dde4-7f34-4106-a091-a01f77693af1 service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:21.744586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:21.745185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:21.745456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:21.745719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:21.755470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:21.757079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:21.765658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1139/2286] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:28:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:28:24.665094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:24.678839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2115153-32bb-4b0b-8a92-18af03f790d6 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:24.686279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:24.686868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:24.687140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:24.687405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:24.689445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:24.756780 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:24.759168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:24.771737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1148/2287] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:31.762415 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=15 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:34.766204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=37 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:45.160586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:45.173359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b702417-b941-46c9-9ff4-5c1388d442de service swift] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:45.180172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:45.180789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:45.181062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:45.181324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:45.183258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:45.195317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:45.197014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df15d55-d54e-4a56-b9e4-fe38161a90a6 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:45.206417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1140/2288] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:55.202186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:28:57.658172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:28:57.698240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641be72d-cc9b-487c-943a-94269a3080f9 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:28:57.711742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:28:57.712682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:57.713256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:57.713693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:57.715619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:57.733111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:28:57.736354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:28:57.756079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1149/2289] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:28:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:28:59.893821 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b1ba-0261-48aa-803a-598922a8f7f0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:28:59.894374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b1ba-0261-48aa-803a-598922a8f7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:28:59.894374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1b1ba-0261-48aa-803a-598922a8f7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:28:59.914624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-d1a1b1ba-0261-48aa-803a-598922a8f7f0 None None] MFA Rules not processed for user `c8982b93df5744bbbdeb7a956df06502`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:28:59.915838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d1a1b1ba-0261-48aa-803a-598922a8f7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:28:59.923468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1141/2290] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:28:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:00.245410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:00.256117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478329f-2c89-44b8-8979-65048fc64c0f service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:00.259016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:00.262027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:00.262419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:00.262714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:00.264694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:00.274973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:00.276482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:00.284905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1150/2291] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:29:06.507950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:06.508475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:06.508475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:06.528289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:06.529490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:06.537034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1142/2292] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 9 12:29:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:06.560581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:06.575176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4ff8a-5ddf-4c96-86d6-bc192daa6345 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:06.590225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:06.590830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:06.591103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:06.591363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:06.600700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:06.602301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:06.610511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1151/2293] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:29:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:29:10.585213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:10.586780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:10.601873 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef6817-ca50-4eb7-9efd-9b9f5de51a20 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:10.612818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:10.613425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:10.613697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:10.613962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:10.615745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:10.628896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:10.630470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:10.641926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1143/2294] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:14.488765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:14.500897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f29b7-e7fe-424a-bed7-ea59bc96bc65 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:14.506633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:14.507249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:14.507548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:14.507797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:14.509766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:14.523039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:14.524671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:14.535281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1152/2295] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:14.546683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:14.548987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:14.618920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0e931-ebe6-4026-8b5a-d59add689497 service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:14.624128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:14.624782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:14.625053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:14.625298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] PATH_INFO: `/v3/users/483f96224f6040a98940f769e30d0e60` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:14.626420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=483f96224f6040a98940f769e30d0e60)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:14.628358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:14.680590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483f96224f6040a98940f769e30d0e60'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:14.689595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483f96224f6040a98940f769e30d0e60'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:14.690310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483f96224f6040a98940f769e30d0e60'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:14.701784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483f96224f6040a98940f769e30d0e60'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:14.702399 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483f96224f6040a98940f769e30d0e60'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:14.714357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1144/2296] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:14 2022] DELETE /identity/v3/users/483f96224f6040a98940f769e30d0e60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:14.891723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:14.905987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5bd43-c445-4a8c-b348-2c5237ff9c67 service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:14.968123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:14.968810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:14.969088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:14.969352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] PATH_INFO: `/v3/projects/125ff55150f6403ba0bccb148121a688` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:14.970619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=125ff55150f6403ba0bccb148121a688)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:14.973320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:15.023589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125ff55150f6403ba0bccb148121a688', 'request_id': 'req-b13dc813-578d-4c94-8a38-7b7ee69393fa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.029946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125ff55150f6403ba0bccb148121a688', 'request_id': 'req-b13dc813-578d-4c94-8a38-7b7ee69393fa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.036664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125ff55150f6403ba0bccb148121a688', 'request_id': 'req-b13dc813-578d-4c94-8a38-7b7ee69393fa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.051380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] The token cache is being invalidate because project 125ff55150f6403ba0bccb148121a688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:15.051676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.052297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.054036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1153/2297] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:14 2022] DELETE /identity/v3/projects/125ff55150f6403ba0bccb148121a688 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:15.058063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:15.059563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:15.073649 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f2797-d2f3-48ce-916a-9b72bf008c45 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:15.131419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:15.145257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:15.146023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:15.146331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:15.146691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] PATH_INFO: `/v3/users/8a44377bee0d4b9db8e645532aca076e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:15.153081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a44377bee0d4b9db8e645532aca076e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:15.155072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:15.205242 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a44377bee0d4b9db8e645532aca076e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.215060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a44377bee0d4b9db8e645532aca076e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.215728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a44377bee0d4b9db8e645532aca076e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.228096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a44377bee0d4b9db8e645532aca076e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.228775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a44377bee0d4b9db8e645532aca076e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.240505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1145/2298] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:15 2022] DELETE /identity/v3/users/8a44377bee0d4b9db8e645532aca076e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:15.418648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:15.420253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:15.436124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dc813-578d-4c94-8a38-7b7ee69393fa admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:15.476813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:15.504194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:15.504878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:15.505157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:15.505428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] PATH_INFO: `/v3/projects/6876493bb4fe400aac8d738ce015d33b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:15.506553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6876493bb4fe400aac8d738ce015d33b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:15.508492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:15.568949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6876493bb4fe400aac8d738ce015d33b', 'request_id': 'req-894e7e9b-06b5-4db8-9109-9e284d7e474c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.577006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6876493bb4fe400aac8d738ce015d33b', 'request_id': 'req-894e7e9b-06b5-4db8-9109-9e284d7e474c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.584075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6876493bb4fe400aac8d738ce015d33b', 'request_id': 'req-894e7e9b-06b5-4db8-9109-9e284d7e474c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.600032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] The token cache is being invalidate because project 6876493bb4fe400aac8d738ce015d33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:15.600313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.600969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-894e7e9b-06b5-4db8-9109-9e284d7e474c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:15.602482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1154/2299] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:15 2022] DELETE /identity/v3/projects/6876493bb4fe400aac8d738ce015d33b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:29:25.237487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:25.597113 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:31.244066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:31.245838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.323435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaef68-602f-49e9-854d-5db29313590e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:31.394030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:31.394644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:31.394917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:31.395177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:31.397007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:31.454262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:31.455952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:31.466390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1146/2300] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:41.461418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=84 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:43.129334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:43.129894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:43.129894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:43.152681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] MFA Rules not processed for user `b6717f94a3844d1b82817e0f4adcebad`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:43.153922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:43.162164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1155/2301] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:48.787348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:48.788973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:48.853140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da88f70-d475-4a28-a71f-a18f3261eb93 service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:48.857466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:48.858308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:48.858449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:48.858665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:48.860615 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:48.933010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:48.934456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:48.945515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1147/2302] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:52.474346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:52.475964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:52.490447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de89c3-7020-47eb-aafc-c3aed01fce01 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:52.495658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:52.497385 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:52.497929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:52.498314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] PATH_INFO: `/v3/users/7dcda8b6ba32416c86b329e2a4ee41e5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:52.499684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcda8b6ba32416c86b329e2a4ee41e5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:52.501683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:52.551141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcda8b6ba32416c86b329e2a4ee41e5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.559361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcda8b6ba32416c86b329e2a4ee41e5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.566778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcda8b6ba32416c86b329e2a4ee41e5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.567458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcda8b6ba32416c86b329e2a4ee41e5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.580086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9109819b-3a64-4c43-a8f3-04044f8e5464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcda8b6ba32416c86b329e2a4ee41e5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.586478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1156/2303] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:52 2022] DELETE /identity/v3/users/7dcda8b6ba32416c86b329e2a4ee41e5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:52.768359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:52.784394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce99023-ef92-40f5-9c1e-9c3fe55ec6c6 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:52.841967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:52.842594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:52.842865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:52.843130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] PATH_INFO: `/v3/projects/eec8510663e74669969800e60e6c422b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:52.844223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec8510663e74669969800e60e6c422b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:52.846161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:52.898392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec8510663e74669969800e60e6c422b', 'request_id': 'req-18af54a8-e34c-4152-83e6-edefff51f9b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.900539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:52.906126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec8510663e74669969800e60e6c422b', 'request_id': 'req-18af54a8-e34c-4152-83e6-edefff51f9b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.912871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec8510663e74669969800e60e6c422b', 'request_id': 'req-18af54a8-e34c-4152-83e6-edefff51f9b6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.927048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] The token cache is being invalidate because project eec8510663e74669969800e60e6c422b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:52.927308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.927952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-18af54a8-e34c-4152-83e6-edefff51f9b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:52.929733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1148/2304] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:52 2022] DELETE /identity/v3/projects/eec8510663e74669969800e60e6c422b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:52.939853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:52.940139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:52.940415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:52.961720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:52.962953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:53.028540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1157/2305] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:53.039460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.039732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.040025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.061884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:53.063079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:53.071347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1149/2306] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:53.076567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.087227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec29e4f-21d3-478d-9647-d4dff8ac940b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.093532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.094135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.094409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.094676 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.095320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:29:53.095620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.097268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.109861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1158/2307] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:29:53.116762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.129154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c704e9-8b49-48b4-8aba-1512c87b74c2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.135088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.135683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.135958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.136222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.136886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.139208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.170244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1150/2308] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:29:53 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:53.178007 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.189009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b1e18-eee3-4dbd-8021-6db7a5345c1a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.250614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:53.261336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.262300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.262783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.263221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.264156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.266699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.293853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1159/2309] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:29:53 2022] POST /identity/v3/users => generated 302 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:53.298314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.309413 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e861d5-1ef3-48d4-a8e8-67733ef7a009 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.320910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.321639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.321912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.322173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.322837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.325035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.344123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1151/2310] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:53.344592 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.362255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a4fb-c068-414b-a583-bcc3fe93ca2a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.367870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f37b6-1791-482c-86e8-6fe509dc88cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.368602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f37b6-1791-482c-86e8-6fe509dc88cd admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.369034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f37b6-1791-482c-86e8-6fe509dc88cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.369438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f37b6-1791-482c-86e8-6fe509dc88cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.385821 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f37b6-1791-482c-86e8-6fe509dc88cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.387647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f37b6-1791-482c-86e8-6fe509dc88cd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.400414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1160/2311] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:29:53.405124 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.414877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c88b-f490-4fea-883f-1a5bc930d90f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.419422 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.420756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.421055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.421278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] PATH_INFO: `/v3/projects/96f08bc1871149da9a13fd08bca01288/users/1c20056670064323a07d37b6169ec917/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.436632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f08bc1871149da9a13fd08bca01288, user_id=1c20056670064323a07d37b6169ec917, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.439289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.453995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1152/2312] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:53 2022] PUT /identity/v3/projects/96f08bc1871149da9a13fd08bca01288/users/1c20056670064323a07d37b6169ec917/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:53.465183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.465475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.465733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.494585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] MFA Rules not processed for user `1c20056670064323a07d37b6169ec917`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:53.495815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:53.564312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1161/2313] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:53.569188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.630068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e0410-a7b3-4fdc-a339-3a166a4413d8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.635108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.635705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.635975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.636237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.636880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.638996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.668288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1153/2314] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:29:53 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:53.673446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.684665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febcc73d-b6e0-4d6b-8db9-e9ac20710e37 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.745748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.746456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.747106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.747372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.748026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.749991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.773579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1162/2315] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:29:53 2022] POST /identity/v3/users => generated 309 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:53.777953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.788836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f05d320-b530-4e27-8157-ddde45b92fd5 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.794978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.795585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.795849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.796112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.796967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.798424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.809730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1154/2316] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:53.814352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.825308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74d538-d78e-436a-ba55-98d95a53c284 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.831331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.832147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.832458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.832753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] PATH_INFO: `/v3/projects/f0422c73e3cd4814b2c1bf66f8f0c20d/users/699b94df2fa24270854120e52f807a9d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.847990 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0422c73e3cd4814b2c1bf66f8f0c20d, user_id=699b94df2fa24270854120e52f807a9d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.850804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.866286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1163/2317] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:53 2022] PUT /identity/v3/projects/f0422c73e3cd4814b2c1bf66f8f0c20d/users/699b94df2fa24270854120e52f807a9d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:53.870326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.881575 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b5f05-c987-4bf6-a87d-a4ac192eca96 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.935732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:53.949194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b2d56-b051-4a27-9752-86377899da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.949850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2d56-b051-4a27-9752-86377899da7c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.950130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2d56-b051-4a27-9752-86377899da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.950400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b2d56-b051-4a27-9752-86377899da7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.951224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b2d56-b051-4a27-9752-86377899da7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.953746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b2d56-b051-4a27-9752-86377899da7c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:53.964730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1155/2318] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:53.968920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:53.983372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa170bf-2340-4863-854a-fa1fa39480d0 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:53.988548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:53.989301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:53.989652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:53.990023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] PATH_INFO: `/v3/projects/f0422c73e3cd4814b2c1bf66f8f0c20d/users/699b94df2fa24270854120e52f807a9d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:53.992056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0422c73e3cd4814b2c1bf66f8f0c20d, user_id=699b94df2fa24270854120e52f807a9d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:53.994904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:54.008005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1164/2319] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:53 2022] PUT /identity/v3/projects/f0422c73e3cd4814b2c1bf66f8f0c20d/users/699b94df2fa24270854120e52f807a9d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:54.019545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:54.019824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:54.020091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:54.054913 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] MFA Rules not processed for user `699b94df2fa24270854120e52f807a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:54.056161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:54.135604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1156/2320] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:54.148640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:54.151460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:54.173651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:54.231203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172513c-7cc6-44c2-a553-5edaa4ab6425 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:54.235576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020a04a-39e8-4589-8ef3-d83192fb94d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:54.236187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a04a-39e8-4589-8ef3-d83192fb94d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:54.236489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a04a-39e8-4589-8ef3-d83192fb94d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:54.236742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a04a-39e8-4589-8ef3-d83192fb94d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:54.248863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020a04a-39e8-4589-8ef3-d83192fb94d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:54.250299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020a04a-39e8-4589-8ef3-d83192fb94d2 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:54.263905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1165/2321] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:54.467631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:54.541188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e6c60-d598-4bd6-b46a-c04b46970fd9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:54.546387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:54.547032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:54.547316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:54.547583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] PATH_INFO: `/v3/users/1c20056670064323a07d37b6169ec917` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:54.548794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c20056670064323a07d37b6169ec917)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:54.550730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:54.605879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c20056670064323a07d37b6169ec917'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:54.615548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c20056670064323a07d37b6169ec917'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:54.616330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c20056670064323a07d37b6169ec917'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:54.633375 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c20056670064323a07d37b6169ec917'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:54.634379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c20056670064323a07d37b6169ec917'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:54.637275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:54.652308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1157/2322] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:54 2022] DELETE /identity/v3/users/1c20056670064323a07d37b6169ec917 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:54.658578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:54.659117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:54.659117 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:54.683822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:54.685245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:54.766750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1166/2323] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:54.780440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:54.782700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:54.854270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833218f-0236-41c3-b73b-e1cf873b886a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:54.859347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:54.859973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:54.860259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:54.860764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:54.873240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:54.874705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:54.886798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1158/2324] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:55.194779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:55.197114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:55.213619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5622-1cd7-4be4-af82-f90df8761920 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:55.218859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:55.219505 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:55.219776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:55.220080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] PATH_INFO: `/v3/projects/96f08bc1871149da9a13fd08bca01288` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:55.221321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f08bc1871149da9a13fd08bca01288)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:55.223211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:55.273987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f08bc1871149da9a13fd08bca01288', 'request_id': 'req-3cca65b4-143d-46ca-a33e-b879239bd177'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.280549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f08bc1871149da9a13fd08bca01288', 'request_id': 'req-3cca65b4-143d-46ca-a33e-b879239bd177'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.287824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f08bc1871149da9a13fd08bca01288', 'request_id': 'req-3cca65b4-143d-46ca-a33e-b879239bd177'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.301596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] The token cache is being invalidate because project 96f08bc1871149da9a13fd08bca01288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:55.301888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.302510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.304054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1167/2325] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:55 2022] DELETE /identity/v3/projects/96f08bc1871149da9a13fd08bca01288 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:55.308152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:55.318122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51071b4f-9ba9-4686-8be2-2b292dd7a030 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:55.377446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:55.378201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:55.384503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:55.384895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] PATH_INFO: `/v3/users/699b94df2fa24270854120e52f807a9d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:55.389556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=699b94df2fa24270854120e52f807a9d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:55.391895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:55.446890 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699b94df2fa24270854120e52f807a9d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.455690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699b94df2fa24270854120e52f807a9d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.456337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699b94df2fa24270854120e52f807a9d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.470061 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699b94df2fa24270854120e52f807a9d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.470909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9b99b8c9-4c18-4149-8438-3691439eeae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699b94df2fa24270854120e52f807a9d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.483333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1159/2326] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:55 2022] DELETE /identity/v3/users/699b94df2fa24270854120e52f807a9d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:29:55.861667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:55.863299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:55.877748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca65b4-143d-46ca-a33e-b879239bd177 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:55.919425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:55.940312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:55.940976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:55.941250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:55.941522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] PATH_INFO: `/v3/projects/f0422c73e3cd4814b2c1bf66f8f0c20d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:55.942650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0422c73e3cd4814b2c1bf66f8f0c20d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:55.944583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:55.992281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0422c73e3cd4814b2c1bf66f8f0c20d', 'request_id': 'req-e8f84515-c397-4352-9cf5-50b9839274cb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:55.998529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0422c73e3cd4814b2c1bf66f8f0c20d', 'request_id': 'req-e8f84515-c397-4352-9cf5-50b9839274cb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:56.004974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0422c73e3cd4814b2c1bf66f8f0c20d', 'request_id': 'req-e8f84515-c397-4352-9cf5-50b9839274cb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:56.023234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] The token cache is being invalidate because project f0422c73e3cd4814b2c1bf66f8f0c20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:56.023509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:56.024367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-e8f84515-c397-4352-9cf5-50b9839274cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:56.026582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1168/2327] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:55 2022] DELETE /identity/v3/projects/f0422c73e3cd4814b2c1bf66f8f0c20d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:56.031681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.032181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.032289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.053400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:56.054604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:56.063643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:56.121174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1160/2328] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:56.130788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.131072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.131343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.153745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:56.155019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:56.164281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1169/2329] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:56.168653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.178994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1f5c0-9735-4a58-8fe2-4648492eeec5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.185017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.185685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.185921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.186298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.186832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:29:56.187127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.188765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.201420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1161/2330] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:29:56.206204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.216647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae5955-6b5f-4e3d-86f6-078adf292993 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.222861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.223527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.223786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.224051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.224826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.226836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.256656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1170/2331] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:56.260662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.270524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed98286-af2a-4af6-b108-c6cc237e1855 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.328704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.329315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.329589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.329872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.330493 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.332454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.355688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1162/2332] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:56.359875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.370702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154a8c-7769-4f6e-93f7-66e986ee86f1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.376478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.377270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.377594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.377864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.378499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.380083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.391573 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1171/2333] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:56.395750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.406762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232dca96-bca2-4554-8449-aed402141ff9 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.411803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0da42-ce7e-48cb-8df2-f5fcfe4b5d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.412441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0da42-ce7e-48cb-8df2-f5fcfe4b5d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.412720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0da42-ce7e-48cb-8df2-f5fcfe4b5d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.412986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0da42-ce7e-48cb-8df2-f5fcfe4b5d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.413664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0da42-ce7e-48cb-8df2-f5fcfe4b5d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.415263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0da42-ce7e-48cb-8df2-f5fcfe4b5d80 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.426453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1163/2334] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:29:56.431002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.441639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcdf9e-113b-4889-817a-25de47ef44c2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.446219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.446933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.447207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.447477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] PATH_INFO: `/v3/projects/e61870737bc14c978777d76a847c3862/users/50042790d9f94792b60e8cb684d37a16/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.462916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61870737bc14c978777d76a847c3862, user_id=50042790d9f94792b60e8cb684d37a16, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.465658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.481627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1172/2335] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:56 2022] PUT /identity/v3/projects/e61870737bc14c978777d76a847c3862/users/50042790d9f94792b60e8cb684d37a16/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:56.491801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.492079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.492343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.520640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] MFA Rules not processed for user `50042790d9f94792b60e8cb684d37a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:56.525885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:56.590728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1164/2336] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:29:56.596034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.662572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ee9d2-7012-40ee-acfd-c5d8a44101cc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.667251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.667848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.668122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.668399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.669035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.671050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.681982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:56.703126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1173/2337] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:56.707449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.718558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8be73a-c7a0-4c98-943f-df39f9cd4079 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.723255 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:56.780169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.780808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.781088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.781357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.781979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.783891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.809960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1165/2338] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:29:56 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:29:56.814850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.829965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1da0b-4091-40a4-98e4-0b633738453c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.835925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.836728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.836861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.837111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.837738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.839327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.851310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1174/2339] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:56.855605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.866057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc81b-d220-4ddf-9ae6-41b625f873b1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.870883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.871539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.872167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.872566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] PATH_INFO: `/v3/projects/84f2479d3cad4d309647d592fa5c5da4/users/cf34068a24d24a1cb28f21b7d2bb7cb5/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.888958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f2479d3cad4d309647d592fa5c5da4, user_id=cf34068a24d24a1cb28f21b7d2bb7cb5, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.892416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.909356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1166/2340] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:56 2022] PUT /identity/v3/projects/84f2479d3cad4d309647d592fa5c5da4/users/cf34068a24d24a1cb28f21b7d2bb7cb5/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:56.913570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:56.926184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca7a84-acb0-4da0-9f31-c039f7928f3c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:56.984481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ac32-49cf-4f12-b9bc-d570f2c1d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:56.985044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ac32-49cf-4f12-b9bc-d570f2c1d688 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:56.985374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ac32-49cf-4f12-b9bc-d570f2c1d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:56.985650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ac32-49cf-4f12-b9bc-d570f2c1d688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:56.986292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ac32-49cf-4f12-b9bc-d570f2c1d688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:56.987898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ac32-49cf-4f12-b9bc-d570f2c1d688 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:56.998615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1175/2341] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:29:57.002788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:57.013526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7276d3e-7c27-499d-a014-34355ba95a6e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:57.018788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:57.019440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:57.019715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:57.019980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] PATH_INFO: `/v3/projects/84f2479d3cad4d309647d592fa5c5da4/users/cf34068a24d24a1cb28f21b7d2bb7cb5/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:57.022120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f2479d3cad4d309647d592fa5c5da4, user_id=cf34068a24d24a1cb28f21b7d2bb7cb5, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:57.024816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:57.035410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1167/2342] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:29:57 2022] PUT /identity/v3/projects/84f2479d3cad4d309647d592fa5c5da4/users/cf34068a24d24a1cb28f21b7d2bb7cb5/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:57.046122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:57.046414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:57.046691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:57.074000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] MFA Rules not processed for user `cf34068a24d24a1cb28f21b7d2bb7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:57.075208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:57.150895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1176/2343] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:57.162688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:57.164592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:57.226363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d9ac-f096-4623-93dc-ed283fd3854c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:57.232855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9b3b9-de4e-4d24-a029-e67f18850fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:57.233458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b3b9-de4e-4d24-a029-e67f18850fce service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:57.233727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b3b9-de4e-4d24-a029-e67f18850fce service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:57.233987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b3b9-de4e-4d24-a029-e67f18850fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:57.244065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9b3b9-de4e-4d24-a029-e67f18850fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:57.245560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9b3b9-de4e-4d24-a029-e67f18850fce service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:57.255772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1168/2344] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:29:57.697621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:57.763826 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193d60f-6656-4a91-8f4a-0802764570ef None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:57.768627 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:57.769263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:57.769540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:57.769812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] PATH_INFO: `/v3/users/50042790d9f94792b60e8cb684d37a16` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:57.771022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=50042790d9f94792b60e8cb684d37a16)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:57.772935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:57.775469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:57.824461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50042790d9f94792b60e8cb684d37a16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:57.834977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50042790d9f94792b60e8cb684d37a16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:57.842525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50042790d9f94792b60e8cb684d37a16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:57.843155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50042790d9f94792b60e8cb684d37a16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:57.854722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50042790d9f94792b60e8cb684d37a16'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:57.861145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1177/2345] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:57 2022] DELETE /identity/v3/users/50042790d9f94792b60e8cb684d37a16 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:57.865788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:57.866133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:57.866406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:57.887393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:57.889789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:57.955234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1169/2346] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:57.964910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:57.966666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:58.026407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb2084-b6dc-46dd-8203-caccc21c33ea admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:58.031543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:58.032096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:58.032419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:58.032692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:58.043863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:58.045579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:58.057585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1178/2347] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:29:58.502548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:58.504007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:58.512321 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:58.516906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf828e2-c1a1-479d-8dc0-01e2931e5c49 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:58.523335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:58.524718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:58.524718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:58.524718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] PATH_INFO: `/v3/projects/e61870737bc14c978777d76a847c3862` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:58.525681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61870737bc14c978777d76a847c3862)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:58.527793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:58.579887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61870737bc14c978777d76a847c3862', 'request_id': 'req-ec8d6231-fa1f-4532-877f-e2e3772dc716'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.586104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61870737bc14c978777d76a847c3862', 'request_id': 'req-ec8d6231-fa1f-4532-877f-e2e3772dc716'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.593610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61870737bc14c978777d76a847c3862', 'request_id': 'req-ec8d6231-fa1f-4532-877f-e2e3772dc716'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.608428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] The token cache is being invalidate because project e61870737bc14c978777d76a847c3862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:58.608716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.609336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.610869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1170/2348] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:58 2022] DELETE /identity/v3/projects/e61870737bc14c978777d76a847c3862 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:29:58.615038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:58.625554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ba343-5e12-4146-866f-3a800ef384fc service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:58.684256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:58.685208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:58.685715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:58.686079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] PATH_INFO: `/v3/users/cf34068a24d24a1cb28f21b7d2bb7cb5` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:58.687327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf34068a24d24a1cb28f21b7d2bb7cb5)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:58.689381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:58.723660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:58.744451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf34068a24d24a1cb28f21b7d2bb7cb5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.753404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf34068a24d24a1cb28f21b7d2bb7cb5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.760889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf34068a24d24a1cb28f21b7d2bb7cb5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.761542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf34068a24d24a1cb28f21b7d2bb7cb5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.773399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-7ce48819-2c98-4c5b-ac1e-b122f28db20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf34068a24d24a1cb28f21b7d2bb7cb5'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:58.779293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1179/2349] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:29:58 2022] DELETE /identity/v3/users/cf34068a24d24a1cb28f21b7d2bb7cb5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:59.407703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:29:59.409665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:59.551795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d6231-fa1f-4532-877f-e2e3772dc716 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:29:59.635276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:29:59.636283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:59.636726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:59.638885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] PATH_INFO: `/v3/projects/84f2479d3cad4d309647d592fa5c5da4` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:59.639817 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f2479d3cad4d309647d592fa5c5da4)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:29:59.642026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:29:59.694618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:29:59.719315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f2479d3cad4d309647d592fa5c5da4', 'request_id': 'req-99da6016-aff7-4f28-93a8-394f9aabb465'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:59.725368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f2479d3cad4d309647d592fa5c5da4', 'request_id': 'req-99da6016-aff7-4f28-93a8-394f9aabb465'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:59.732433 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f2479d3cad4d309647d592fa5c5da4', 'request_id': 'req-99da6016-aff7-4f28-93a8-394f9aabb465'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:59.754829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] The token cache is being invalidate because project 84f2479d3cad4d309647d592fa5c5da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:29:59.755378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:59.756247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-99da6016-aff7-4f28-93a8-394f9aabb465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:29:59.758381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1171/2350] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:29:59 2022] DELETE /identity/v3/projects/84f2479d3cad4d309647d592fa5c5da4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:29:59.764883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:59.765453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:59.765453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:59.847543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:59.850550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:29:59.932581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1180/2351] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:29:59.942380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:29:59.942380 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:29:59.942690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:29:59.979277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:29:59.980675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:00.001203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1172/2352] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:00.001356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.023568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf425f0-fc96-4ec8-b823-21c10e5cff2a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.040499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.041321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.041602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.041874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.042545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:00.042857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.045384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.082084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1181/2353] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:30:00.085202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.096854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b22f-ab9c-43da-b86a-a89c62dbc359 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.119916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.120586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.120866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.121133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.122195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.124291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.207816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1173/2354] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:00 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:00.212182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.226089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830e05-2555-47ff-be1b-f8f55ec812d5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.355370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.356170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.356599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.357091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.357951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.359992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.372166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:00.399935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.404810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1182/2355] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:00 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:00.414184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c9ffc-8005-4412-9903-b0749bacde39 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.419140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.420121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.420423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.420828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.421666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.423203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.438708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1174/2356] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:00.439737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.455547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70af4ac-1786-4b10-b029-22dea5fc7168 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.461279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1be4c7-97f9-4c88-b41f-52cf7b5569e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.462422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be4c7-97f9-4c88-b41f-52cf7b5569e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.463149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be4c7-97f9-4c88-b41f-52cf7b5569e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.463728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1be4c7-97f9-4c88-b41f-52cf7b5569e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.464623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1be4c7-97f9-4c88-b41f-52cf7b5569e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.466746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1be4c7-97f9-4c88-b41f-52cf7b5569e5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.484711 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.492082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1183/2357] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:30:00.497942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a6c09-5891-4e18-a2f6-e4dd3fdd71ad admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.503192 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.504953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.505594 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.506223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] PATH_INFO: `/v3/projects/2e8236ee0b054fedb603665c023f2fcd/users/8ff7d2bfc609463b88995b185b62db19/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.523505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8236ee0b054fedb603665c023f2fcd, user_id=8ff7d2bfc609463b88995b185b62db19, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.526279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.543961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1175/2358] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:00 2022] PUT /identity/v3/projects/2e8236ee0b054fedb603665c023f2fcd/users/8ff7d2bfc609463b88995b185b62db19/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:00.554361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.554637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.554906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.583824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] MFA Rules not processed for user `8ff7d2bfc609463b88995b185b62db19`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:00.584998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:00.662625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1184/2359] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:00.667394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.771102 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61c28-bec5-481f-829e-bbcdb74eea1b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.777189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.778452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.778452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.778452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.779035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.781014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.817064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1176/2360] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:00 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:00.818207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.840014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbef4a-4550-4e4d-bb04-ad1d12dbd92f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:00.947717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:00.948631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:00.949086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:00.949527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:00.950359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:00.952501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:00.983000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1185/2361] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:00 2022] POST /identity/v3/users => generated 307 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:00.987001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:00.998233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67492371-151f-4e45-8c4d-9ad64e70484e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:01.004088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:01.007587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.008564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.008846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.009538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:01.011785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:01.024304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1177/2362] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:01.028791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:01.042703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b8325-d8ca-434b-9314-7ab8621e0a16 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:01.056353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:01.057335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.057775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.058047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] PATH_INFO: `/v3/projects/d7d8690255f246359e867dee3a63c961/users/d1083314eeb34e92b2177fd6a5b98768/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.077432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d8690255f246359e867dee3a63c961, user_id=d1083314eeb34e92b2177fd6a5b98768, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:01.083036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:01.099842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1186/2363] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:01 2022] PUT /identity/v3/projects/d7d8690255f246359e867dee3a63c961/users/d1083314eeb34e92b2177fd6a5b98768/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:01.103694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:01.115444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd21178-27ba-417b-b012-cc4265901d54 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:01.142991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:01.177028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44f33b-29b7-4e7a-8619-03cd3f6898a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:01.177645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f33b-29b7-4e7a-8619-03cd3f6898a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.177920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f33b-29b7-4e7a-8619-03cd3f6898a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.178186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44f33b-29b7-4e7a-8619-03cd3f6898a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.178828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44f33b-29b7-4e7a-8619-03cd3f6898a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:01.180573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44f33b-29b7-4e7a-8619-03cd3f6898a4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:01.193304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1178/2364] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:01.198243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:01.212115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d9be9-b896-4e18-85cf-6371b3b6f971 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:01.217560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:01.218227 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.218503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.218773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] PATH_INFO: `/v3/projects/d7d8690255f246359e867dee3a63c961/users/d1083314eeb34e92b2177fd6a5b98768/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.220750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d8690255f246359e867dee3a63c961, user_id=d1083314eeb34e92b2177fd6a5b98768, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:01.223444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:01.237896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1187/2365] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:01 2022] PUT /identity/v3/projects/d7d8690255f246359e867dee3a63c961/users/d1083314eeb34e92b2177fd6a5b98768/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:01.249593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49743-bb54-4470-8646-11391b12d799 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.249885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49743-bb54-4470-8646-11391b12d799 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.250149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e49743-bb54-4470-8646-11391b12d799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.281576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-26e49743-bb54-4470-8646-11391b12d799 None None] MFA Rules not processed for user `d1083314eeb34e92b2177fd6a5b98768`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:01.282944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-26e49743-bb54-4470-8646-11391b12d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:01.368515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1179/2366] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:01 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:01.378028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:01.380371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:01.407488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:01.472471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cd17e-5c4a-4127-b6e0-3aa1b7708d9b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:01.476852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd008bc-9d35-4652-8da5-d61a8d8e79a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:01.477550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd008bc-9d35-4652-8da5-d61a8d8e79a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.477912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd008bc-9d35-4652-8da5-d61a8d8e79a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.478319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd008bc-9d35-4652-8da5-d61a8d8e79a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.488611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd008bc-9d35-4652-8da5-d61a8d8e79a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:01.490160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd008bc-9d35-4652-8da5-d61a8d8e79a4 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:01.505766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1188/2367] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:01.595810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49743-bb54-4470-8646-11391b12d799 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:01.605769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e49743-bb54-4470-8646-11391b12d799 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:01.609508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:01.610116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:01.610391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:01.610684 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:01.670838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:01.672277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:01.681118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1180/2368] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:03.543023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6456b49-207a-455a-90eb-5e773198de59 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:03.543499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6456b49-207a-455a-90eb-5e773198de59 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:03.543661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6456b49-207a-455a-90eb-5e773198de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:03.564035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c6456b49-207a-455a-90eb-5e773198de59 None None] MFA Rules not processed for user `adadf92bd9ec48dfbb4eb5977edab923`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:03.565272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c6456b49-207a-455a-90eb-5e773198de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:03.625851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1189/2369] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:05.818407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:05.868282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:05.891644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ec96e-efb3-45c1-a87a-58ba3689f599 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:05.896427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:05.897069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:05.897344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:05.897614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] PATH_INFO: `/v3/users/8ff7d2bfc609463b88995b185b62db19` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:05.898768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff7d2bfc609463b88995b185b62db19)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:05.900857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:05.952150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff7d2bfc609463b88995b185b62db19'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:05.961208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff7d2bfc609463b88995b185b62db19'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:05.961826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff7d2bfc609463b88995b185b62db19'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:05.973994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff7d2bfc609463b88995b185b62db19'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:05.974634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff7d2bfc609463b88995b185b62db19'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:05.988420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1181/2370] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:05 2022] DELETE /identity/v3/users/8ff7d2bfc609463b88995b185b62db19 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:05.993196 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:05.993687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:05.993785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:06.013982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:06.015219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:06.080941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1190/2371] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:06.090978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:06.092650 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:06.152161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1c8e0-4403-4bb8-9d02-deaf72570db3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:06.156333 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:06.156961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:06.157232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:06.157494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:06.167096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:06.168547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:06.178004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1182/2372] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:06.470493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:06.472020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:06.487542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd1667-246a-4756-8c89-5e02688bf92f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:06.494319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:06.494852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:06.495149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:06.495383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] PATH_INFO: `/v3/projects/2e8236ee0b054fedb603665c023f2fcd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:06.496996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8236ee0b054fedb603665c023f2fcd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:06.499581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:06.548224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:06.549634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8236ee0b054fedb603665c023f2fcd', 'request_id': 'req-81770861-c57f-4810-9b8f-4a7521261b1d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.556501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8236ee0b054fedb603665c023f2fcd', 'request_id': 'req-81770861-c57f-4810-9b8f-4a7521261b1d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.563183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8236ee0b054fedb603665c023f2fcd', 'request_id': 'req-81770861-c57f-4810-9b8f-4a7521261b1d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.576937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] The token cache is being invalidate because project 2e8236ee0b054fedb603665c023f2fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:06.577796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.578552 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.580102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1191/2373] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:06 2022] DELETE /identity/v3/projects/2e8236ee0b054fedb603665c023f2fcd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:06.584494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:06.596495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a23e9-4809-4e50-856b-9e3ffc34be40 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:06.661669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:06.662340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:06.662618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:06.662893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] PATH_INFO: `/v3/users/d1083314eeb34e92b2177fd6a5b98768` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:06.664091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1083314eeb34e92b2177fd6a5b98768)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:06.666171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:06.677286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:06.718386 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1083314eeb34e92b2177fd6a5b98768'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.727420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1083314eeb34e92b2177fd6a5b98768'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.728120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1083314eeb34e92b2177fd6a5b98768'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.743974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1083314eeb34e92b2177fd6a5b98768'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.745451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-76e1b6ce-4d1f-4929-9b1e-7c0335692ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1083314eeb34e92b2177fd6a5b98768'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:06.759490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1183/2374] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:06 2022] DELETE /identity/v3/users/d1083314eeb34e92b2177fd6a5b98768 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:07.299849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.301416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:07.316354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81770861-c57f-4810-9b8f-4a7521261b1d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.385304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.386213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.386213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.386487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] PATH_INFO: `/v3/projects/d7d8690255f246359e867dee3a63c961` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.388600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d8690255f246359e867dee3a63c961)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:07.390618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:07.454465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d8690255f246359e867dee3a63c961', 'request_id': 'req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:07.461985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d8690255f246359e867dee3a63c961', 'request_id': 'req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:07.469296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d8690255f246359e867dee3a63c961', 'request_id': 'req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:07.489942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] The token cache is being invalidate because project d7d8690255f246359e867dee3a63c961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:07.490310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:07.491095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-9d170693-ccfc-4120-b4d1-64ebdbd6af7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:07.492687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1192/2375] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:07 2022] DELETE /identity/v3/projects/d7d8690255f246359e867dee3a63c961 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:07.498301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.498953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.498953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.520696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:07.522029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:07.595323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1184/2376] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:30:07.603562 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.603856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.604132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.627396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:07.628784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:07.639120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1193/2377] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:07.643992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.656056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8de15-ac4e-4088-854d-09ed60fe4bb0 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.662177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.662768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.663050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.663313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.663975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:07.664272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:07.666095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:07.683502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1185/2378] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:30:07.687804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.698171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5896b7f-6d32-4d90-8888-5ae609e5855f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.704167 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.704828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.705090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.705502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.706139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:07.708038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:07.740298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1194/2379] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:07 2022] POST /identity/v3/projects => generated 409 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:07.744963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.756824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a79f-9f8c-496f-8a95-9b807b8566ec admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.826147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.826762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.827223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.828175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.828858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:07.830802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:07.856520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1186/2380] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:07 2022] POST /identity/v3/users => generated 305 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:07.860880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.873471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ca227-9c00-4627-9a4c-a87fbf5a63a2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.879488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.880201 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.885429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.885429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.885429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:07.885429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:07.898816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1195/2381] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:07.902699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.910617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:07.914808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7eadb6-65de-4ea4-b665-9098876b111e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.922895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a31e0-61ad-46f3-9f8b-d36edfd2225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.923724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a31e0-61ad-46f3-9f8b-d36edfd2225c admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.924419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a31e0-61ad-46f3-9f8b-d36edfd2225c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.924840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a31e0-61ad-46f3-9f8b-d36edfd2225c admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.925604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a31e0-61ad-46f3-9f8b-d36edfd2225c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:07.927686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a31e0-61ad-46f3-9f8b-d36edfd2225c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:07.951474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1187/2382] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:30:07.955581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:07.968262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a0c6-d3be-4962-a480-b510d0886c39 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:07.974321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:07.975142 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:07.975472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:07.975743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] PATH_INFO: `/v3/projects/132ac03d1437478b83f3e42f1e6fae62/users/3aae6bd14be44cd5bca74f9464ad2a3c/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:07.998455 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132ac03d1437478b83f3e42f1e6fae62, user_id=3aae6bd14be44cd5bca74f9464ad2a3c, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.002136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.017822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1196/2383] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:07 2022] PUT /identity/v3/projects/132ac03d1437478b83f3e42f1e6fae62/users/3aae6bd14be44cd5bca74f9464ad2a3c/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:08.028039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e536f-faf3-4c78-9121-06bb475536de None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.028324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e536f-faf3-4c78-9121-06bb475536de None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.028623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e536f-faf3-4c78-9121-06bb475536de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.059664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-101e536f-faf3-4c78-9121-06bb475536de None None] MFA Rules not processed for user `3aae6bd14be44cd5bca74f9464ad2a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:08.061645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-101e536f-faf3-4c78-9121-06bb475536de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:08.143346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1188/2384] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:08.148134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.153252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:08.290106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba070d0-5ef4-4f56-a271-6c5053a4df25 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:08.306771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:08.307435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.307670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.307938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.308581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.310584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.353967 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1197/2385] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:08 2022] POST /identity/v3/projects => generated 409 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:08.358147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e536f-faf3-4c78-9121-06bb475536de None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.369887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e536f-faf3-4c78-9121-06bb475536de None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:08.439735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:08.439735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.439735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.439735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.440159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.440159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.464336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1189/2386] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:08 2022] POST /identity/v3/users => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:08.468737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.482984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee86f16-1aa3-4d66-92e8-26487c3fe3c6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:08.488364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:08.489187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.489636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.490067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.492241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.494066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.506355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1198/2387] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:08.510696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.524982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f751b2-9be3-4d40-9072-0f28d2273ff1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:08.531116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:08.531548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.533098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.533381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] PATH_INFO: `/v3/projects/28ad7b919314467baff9a6422b9e6ade/users/7bb86149c3184614b11a554fca01d841/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.558329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ad7b919314467baff9a6422b9e6ade, user_id=7bb86149c3184614b11a554fca01d841, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.561619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.581281 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1190/2388] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:08 2022] PUT /identity/v3/projects/28ad7b919314467baff9a6422b9e6ade/users/7bb86149c3184614b11a554fca01d841/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:08.582651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.594267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9eed0-6abc-4490-aacd-fdf69dec1955 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:08.699138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213d39-924a-45e2-a4fa-5d64672c6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:08.699691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213d39-924a-45e2-a4fa-5d64672c6efd admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.699968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213d39-924a-45e2-a4fa-5d64672c6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.700504 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213d39-924a-45e2-a4fa-5d64672c6efd admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.701194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213d39-924a-45e2-a4fa-5d64672c6efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.703160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213d39-924a-45e2-a4fa-5d64672c6efd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.719016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1199/2389] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:08.723244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.751152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a76d09-3eef-4db4-8732-d2f020a3dbca admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:08.767282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:08.767964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.768246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.768554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] PATH_INFO: `/v3/projects/28ad7b919314467baff9a6422b9e6ade/users/7bb86149c3184614b11a554fca01d841/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.772306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ad7b919314467baff9a6422b9e6ade, user_id=7bb86149c3184614b11a554fca01d841, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:08.775136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:08.789695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1191/2390] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:08 2022] PUT /identity/v3/projects/28ad7b919314467baff9a6422b9e6ade/users/7bb86149c3184614b11a554fca01d841/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:08.801297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:08.801611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:08.801885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:08.832595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] MFA Rules not processed for user `7bb86149c3184614b11a554fca01d841`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:08.834218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:08.913258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:08.922393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1200/2391] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:08 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:08.934536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:08.936694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:08.982143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:09.004787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff698cec-1c2b-4376-ae2c-97e159968e97 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:09.010107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff150d6-94f0-4972-9482-fd3445b6f6cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:09.010721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff150d6-94f0-4972-9482-fd3445b6f6cd service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:09.010994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff150d6-94f0-4972-9482-fd3445b6f6cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:09.011259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff150d6-94f0-4972-9482-fd3445b6f6cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:09.021481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff150d6-94f0-4972-9482-fd3445b6f6cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:09.023751 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff150d6-94f0-4972-9482-fd3445b6f6cd service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:09.033955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1192/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:08 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:09.224530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:09.242772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d77b6-1081-4903-bd37-cb735f93653c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:09.248522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:09.249401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:09.249703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:09.249948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:09.322425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:09.325218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:09.336472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1201/2393] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:09 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:10.669366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769765-dee6-4102-ac61-550bcdfddb81 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:10.669834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769765-dee6-4102-ac61-550bcdfddb81 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:10.669931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1769765-dee6-4102-ac61-550bcdfddb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:10.689056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c1769765-dee6-4102-ac61-550bcdfddb81 None None] MFA Rules not processed for user `50fa6727271142eba979bb4562a2b853`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:10.690246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c1769765-dee6-4102-ac61-550bcdfddb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:10.755297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1193/2394] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:19.060620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:19.140475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab510c-a033-457e-a6a6-a44f4e54a674 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:19.145812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:19.146525 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:19.146804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:19.147118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] PATH_INFO: `/v3/users/3aae6bd14be44cd5bca74f9464ad2a3c` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:19.148424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aae6bd14be44cd5bca74f9464ad2a3c)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:19.150432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:19.204960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aae6bd14be44cd5bca74f9464ad2a3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:19.214413 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aae6bd14be44cd5bca74f9464ad2a3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:19.222517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aae6bd14be44cd5bca74f9464ad2a3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:19.223558 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aae6bd14be44cd5bca74f9464ad2a3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:19.240941 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aae6bd14be44cd5bca74f9464ad2a3c'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:19.247429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1202/2395] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:19 2022] DELETE /identity/v3/users/3aae6bd14be44cd5bca74f9464ad2a3c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:19.252217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:19.252717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:19.252839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:19.273029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:19.274228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:19.334641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1194/2396] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:19.345006 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:19.347372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:19.374801 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:19.438805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027213-9f62-4080-b2f4-f2a60bfc7a53 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:19.443416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:19.444030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:19.444300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:19.444571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:19.454466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:19.455892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:19.466394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1203/2397] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:19.962536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:19.964136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:19.976216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0bfdc-718e-4c40-b795-93b6b1780d4e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:19.981810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:19.982459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:19.982736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:19.983001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] PATH_INFO: `/v3/projects/132ac03d1437478b83f3e42f1e6fae62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:19.984114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132ac03d1437478b83f3e42f1e6fae62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:19.986262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:20.038588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132ac03d1437478b83f3e42f1e6fae62', 'request_id': 'req-216c3eb5-9df1-4408-bb3c-8510d1ade135'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.044108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132ac03d1437478b83f3e42f1e6fae62', 'request_id': 'req-216c3eb5-9df1-4408-bb3c-8510d1ade135'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.050484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132ac03d1437478b83f3e42f1e6fae62', 'request_id': 'req-216c3eb5-9df1-4408-bb3c-8510d1ade135'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.069293 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] The token cache is being invalidate because project 132ac03d1437478b83f3e42f1e6fae62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:20.069660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.070771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.073204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1195/2398] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:19 2022] DELETE /identity/v3/projects/132ac03d1437478b83f3e42f1e6fae62 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:20.078825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:20.089924 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b19f38-489b-4676-a57b-1f142ead4170 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:20.157226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:20.157869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:20.158141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:20.158408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] PATH_INFO: `/v3/users/7bb86149c3184614b11a554fca01d841` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:20.159900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb86149c3184614b11a554fca01d841)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:20.161872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:20.229574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb86149c3184614b11a554fca01d841'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.238500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb86149c3184614b11a554fca01d841'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.255662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb86149c3184614b11a554fca01d841'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.255662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb86149c3184614b11a554fca01d841'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.259963 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5ede5f6d-ed34-4bbb-ace0-243863870fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb86149c3184614b11a554fca01d841'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.265851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1204/2399] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:20 2022] DELETE /identity/v3/users/7bb86149c3184614b11a554fca01d841 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:20.556137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:20.557705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:20.571687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c3eb5-9df1-4408-bb3c-8510d1ade135 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:20.575581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:20.633629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:20.634265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:20.634540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:20.634808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] PATH_INFO: `/v3/projects/28ad7b919314467baff9a6422b9e6ade` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:20.635916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ad7b919314467baff9a6422b9e6ade)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:20.637850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:20.690299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ad7b919314467baff9a6422b9e6ade', 'request_id': 'req-48ca6424-6a42-4a59-b771-f78cb66d6130'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.696307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ad7b919314467baff9a6422b9e6ade', 'request_id': 'req-48ca6424-6a42-4a59-b771-f78cb66d6130'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.702559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ad7b919314467baff9a6422b9e6ade', 'request_id': 'req-48ca6424-6a42-4a59-b771-f78cb66d6130'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.718141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] The token cache is being invalidate because project 28ad7b919314467baff9a6422b9e6ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:20.718430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.719053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-48ca6424-6a42-4a59-b771-f78cb66d6130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:20.720575 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1196/2400] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:20 2022] DELETE /identity/v3/projects/28ad7b919314467baff9a6422b9e6ade => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:20.725705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:20.726718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:20.727003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:20.776528 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:20.777773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:20.793548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:20.844343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1205/2401] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:20.853573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:20.853943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:20.854261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:20.877890 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:20.879315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:20.892883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:20.893868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1197/2402] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:20.904243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1779334-cbba-48bf-86d8-4bf051a973ef None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:20.909350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:20.909957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:20.910241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:20.910547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:20.911203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:20.911527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:20.913270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:20.925758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1206/2403] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:30:20.930210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:20.939671 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0b1b-f2bd-4540-802a-5bd486262f89 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:20.944696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:20.945301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:20.945581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:20.945841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:20.946463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:20.948362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:20.979919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1198/2404] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:20 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:20.983386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:20.993678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96d51c-9950-4d00-af28-9316ba4cb367 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.053051 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.053668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.053969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.054241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.054862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.056893 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.080442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1207/2405] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:20 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:21.084736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.098702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcdb71-13ef-48cd-af51-e1f38534c8b6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.103477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.104130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.104460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.104732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.105376 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.107001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.117871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1199/2406] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:21.122287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.132436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdebeec-0553-4ffa-8a29-b702e35e46dc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.137153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178f0ec-4e18-45f6-ba59-1a5b2267f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.137758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178f0ec-4e18-45f6-ba59-1a5b2267f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.138036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178f0ec-4e18-45f6-ba59-1a5b2267f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.138309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178f0ec-4e18-45f6-ba59-1a5b2267f4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.138966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178f0ec-4e18-45f6-ba59-1a5b2267f4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.140583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178f0ec-4e18-45f6-ba59-1a5b2267f4bf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.152458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1208/2407] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:21.156839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.167980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ea6b0-3656-4da1-9b79-7efdbf516df6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.173394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.174098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.174418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.174693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] PATH_INFO: `/v3/projects/10363eb47ffc4bf8bf6d4b3128cfdde3/users/db75033077954930b6a5eea78d58d50d/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.192075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10363eb47ffc4bf8bf6d4b3128cfdde3, user_id=db75033077954930b6a5eea78d58d50d, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.194823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.210064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1200/2408] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:21 2022] PUT /identity/v3/projects/10363eb47ffc4bf8bf6d4b3128cfdde3/users/db75033077954930b6a5eea78d58d50d/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:21.220833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.221118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.221387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.250669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] MFA Rules not processed for user `db75033077954930b6a5eea78d58d50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:21.251920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:21.319232 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1209/2409] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:21.323621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.359253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.389550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a2b38-dd02-4f1f-aa77-b1dbd455b9a3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.394391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.394998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.395298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.395568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.396203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.398156 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.427123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1201/2410] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:21 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:21.433482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.444802 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dcb6-72d4-443c-bb39-68b3b0001042 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.455153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:21.504879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.505585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.505860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.506126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.506749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.508688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.532480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1210/2411] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:21 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:21.536803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.547572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c705bdc-3da5-4663-83a0-7b3927e3f882 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.552482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.553091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.553365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.553627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.554265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.555860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.567206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1202/2412] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:30:21.571452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.581445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48f30f-0aac-43b9-a753-c2966630cab9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.586259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.586910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.587163 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.587449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] PATH_INFO: `/v3/projects/4f29c91a384b4ca783ff0b7167a2e80b/users/5012277703314760b05ba181950db6d4/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.603296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f29c91a384b4ca783ff0b7167a2e80b, user_id=5012277703314760b05ba181950db6d4, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.605978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.623036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1211/2413] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:21 2022] PUT /identity/v3/projects/4f29c91a384b4ca783ff0b7167a2e80b/users/5012277703314760b05ba181950db6d4/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:21.627079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.637665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d13c9-1c03-4580-b554-f5a458c44ce8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.697760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad565a-8884-4b91-ae90-09409a1e5f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.698480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad565a-8884-4b91-ae90-09409a1e5f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.698759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad565a-8884-4b91-ae90-09409a1e5f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.699032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad565a-8884-4b91-ae90-09409a1e5f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.699681 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad565a-8884-4b91-ae90-09409a1e5f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.701314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad565a-8884-4b91-ae90-09409a1e5f82 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.711379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1203/2414] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:21.715661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.728478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83332911-a9bc-495b-8f60-56fe9ab862a1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:21.734376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:21.735371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.736015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.736015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] PATH_INFO: `/v3/projects/4f29c91a384b4ca783ff0b7167a2e80b/users/5012277703314760b05ba181950db6d4/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.738125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f29c91a384b4ca783ff0b7167a2e80b, user_id=5012277703314760b05ba181950db6d4, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:21.740793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:21.752315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1212/2415] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:21 2022] PUT /identity/v3/projects/4f29c91a384b4ca783ff0b7167a2e80b/users/5012277703314760b05ba181950db6d4/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:21.825926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:21.826397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:21.826768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:21.863062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] MFA Rules not processed for user `5012277703314760b05ba181950db6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:21.864502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:21.964174 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1204/2416] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:21.976013 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:21.977888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:22.036623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea71bd-0faf-4309-9ac6-82f88d3782a8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:22.041279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:22.041972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:22.042492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:22.042976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:22.055654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:22.057115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:22.068050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1213/2417] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:22.165506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:22.175899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe83273-4dad-4783-9376-f11e4c138b06 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:22.180273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2dde7-53a4-4287-8103-29101241ac38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:22.180912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2dde7-53a4-4287-8103-29101241ac38 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:22.181183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2dde7-53a4-4287-8103-29101241ac38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:22.181443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2dde7-53a4-4287-8103-29101241ac38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:22.209151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:22.242826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2dde7-53a4-4287-8103-29101241ac38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:22.244261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab2dde7-53a4-4287-8103-29101241ac38 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:22.253903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1205/2418] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:22.540579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:22.614178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1938e4-b72d-41e7-ae89-6034e8c6ed6d service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:22.620365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:22.621713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:22.621991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:22.622256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] PATH_INFO: `/v3/users/db75033077954930b6a5eea78d58d50d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:22.623454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db75033077954930b6a5eea78d58d50d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:22.625442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:22.639500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:22.687195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db75033077954930b6a5eea78d58d50d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:22.700906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db75033077954930b6a5eea78d58d50d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:22.708589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db75033077954930b6a5eea78d58d50d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:22.709267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db75033077954930b6a5eea78d58d50d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:22.730976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db75033077954930b6a5eea78d58d50d'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:22.738788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1214/2419] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:22 2022] DELETE /identity/v3/users/db75033077954930b6a5eea78d58d50d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:22.743263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:22.743713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:22.743881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:22.764908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:22.766308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:22.836645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1206/2420] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:22.845538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:22.847190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:22.927236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77f14c-86a5-4d43-a7bd-c520958a52f1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:22.932256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:22.932992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:22.933356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:22.933695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:22.944239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:22.945854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:22.957598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1215/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:23.386552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:23.389800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:23.404822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364185bd-fe4c-4641-a5d9-c17955fcd211 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:23.410317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:23.411164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:23.411659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:23.411960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] PATH_INFO: `/v3/projects/10363eb47ffc4bf8bf6d4b3128cfdde3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:23.413143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10363eb47ffc4bf8bf6d4b3128cfdde3)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:23.415078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:23.474812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10363eb47ffc4bf8bf6d4b3128cfdde3', 'request_id': 'req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.480365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10363eb47ffc4bf8bf6d4b3128cfdde3', 'request_id': 'req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.487129 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10363eb47ffc4bf8bf6d4b3128cfdde3', 'request_id': 'req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.501813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] The token cache is being invalidate because project 10363eb47ffc4bf8bf6d4b3128cfdde3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:23.502118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.502725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.504396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1207/2422] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:23 2022] DELETE /identity/v3/projects/10363eb47ffc4bf8bf6d4b3128cfdde3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:23.508728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:23.518944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34180466-26cf-425e-a870-f2843e30cfa5 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:23.576732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:23.577467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:23.577641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:23.577935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] PATH_INFO: `/v3/users/5012277703314760b05ba181950db6d4` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:23.579118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5012277703314760b05ba181950db6d4)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:23.581707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:23.622896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:23.639621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5012277703314760b05ba181950db6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.651466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5012277703314760b05ba181950db6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.661589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5012277703314760b05ba181950db6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.662437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5012277703314760b05ba181950db6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.674806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d6880a71-7e32-4a10-b920-4db45f83e944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5012277703314760b05ba181950db6d4'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:23.681020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1216/2423] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:30:23 2022] DELETE /identity/v3/users/5012277703314760b05ba181950db6d4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:23.962902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:23.964547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:23.979635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c941ed98-fc6f-4b8b-a5ae-8dad11bb95e1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.032568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:24.044502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.045199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.045709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.045997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] PATH_INFO: `/v3/projects/4f29c91a384b4ca783ff0b7167a2e80b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.047354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f29c91a384b4ca783ff0b7167a2e80b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.049334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.103164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f29c91a384b4ca783ff0b7167a2e80b', 'request_id': 'req-b406a896-c03c-4620-8cc1-bdd139470f59'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.109300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f29c91a384b4ca783ff0b7167a2e80b', 'request_id': 'req-b406a896-c03c-4620-8cc1-bdd139470f59'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.115943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f29c91a384b4ca783ff0b7167a2e80b', 'request_id': 'req-b406a896-c03c-4620-8cc1-bdd139470f59'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.131027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] The token cache is being invalidate because project 4f29c91a384b4ca783ff0b7167a2e80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:30:24.131314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.131950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b406a896-c03c-4620-8cc1-bdd139470f59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:30:24.133519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1208/2424] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:30:23 2022] DELETE /identity/v3/projects/4f29c91a384b4ca783ff0b7167a2e80b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:24.138727 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.139012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.139283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.160817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:24.162076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:24.223372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1217/2425] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:24.231297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.231580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.231850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.252346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:24.253632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:24.262039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1209/2426] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:24.266308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.276291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a9fcd-baec-44c9-bc33-d9a8ac68b3f4 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.281433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.282027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.282303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.282565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.283200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:30:24.283491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.285221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.297038 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1218/2427] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:30:24.301630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.310936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec3327-adfe-4c37-a86a-f041953edba8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.315993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.316625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.316922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.317259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.317880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.319777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.349173 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1210/2428] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:24 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:30:24.353412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.363866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d514225-06d8-4568-b10e-45149ab17bd1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.422411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.423046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.423317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.423580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.424189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.426639 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.449476 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1219/2429] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:24 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:24.453721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.464287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64acca6-3df3-4c51-a16e-cce0169690da admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.469401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.470013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.470287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.470575 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.471207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.473032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.483464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1211/2430] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:24.487554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.497889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a22a0-09fe-4588-b551-cf5ac83a1bc7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.504074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f3ed6-0cbe-4be9-b47b-80bb8ffaea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.504705 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f3ed6-0cbe-4be9-b47b-80bb8ffaea55 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.504974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f3ed6-0cbe-4be9-b47b-80bb8ffaea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.505236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f3ed6-0cbe-4be9-b47b-80bb8ffaea55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.505865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f3ed6-0cbe-4be9-b47b-80bb8ffaea55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.507454 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f3ed6-0cbe-4be9-b47b-80bb8ffaea55 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.518785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1220/2431] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:24.523167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.533265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8639010-9418-4167-870a-8a16a853244d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.538091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.538735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.539008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.539272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] PATH_INFO: `/v3/projects/bc3caeb344224a6b9ead2052d0b44909/users/72593249ee4843e9bb3ae413bfccf8b7/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.556246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc3caeb344224a6b9ead2052d0b44909, user_id=72593249ee4843e9bb3ae413bfccf8b7, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.560785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.582199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1212/2432] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:24 2022] PUT /identity/v3/projects/bc3caeb344224a6b9ead2052d0b44909/users/72593249ee4843e9bb3ae413bfccf8b7/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:24.588855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b4159-6c1f-4f32-88bb-9bf4791a5e29 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.589364 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b4159-6c1f-4f32-88bb-9bf4791a5e29 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.589466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b4159-6c1f-4f32-88bb-9bf4791a5e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.610483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-789b4159-6c1f-4f32-88bb-9bf4791a5e29 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:24.611678 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-789b4159-6c1f-4f32-88bb-9bf4791a5e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:24.622938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:24.674808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1221/2433] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:24.684685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:24.687009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:24.744865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbfe3c0-52c4-47be-a884-59a06af743d4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:24.749557 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:24.750166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:24.750449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:24.750779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:24.760143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:24.761614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:24.771595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1213/2434] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:28.973586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:28.974402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:28.975087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.017966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] MFA Rules not processed for user `72593249ee4843e9bb3ae413bfccf8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:29.019381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:29.094538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1222/2435] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:29.099244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:29.109503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d570e-4bc2-40d7-9b79-d4920d414e6d service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:29.114863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:29.115683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:29.116091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:29.116572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.117358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:29.119504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:29.144310 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:29.152437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1214/2436] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:30:29 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:29.156863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:29.169219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5429a-f653-4ce7-804c-d5d809eb0258 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:29.233069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:29.234008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:29.234399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:29.234760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.235501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:29.238348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:29.266833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1223/2437] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:30:29 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:30:29.268130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:29.278985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ac86a-adc7-4886-812d-dba7c12d4101 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:29.283549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:29.284235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:29.284548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:29.284880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.285470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:29.287086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:29.298511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1215/2438] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:29.302996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:29.313633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbda70-c36a-4a1f-880c-8a9ec775dd9c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:29.319307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:29.319985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:29.320266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:29.320588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] PATH_INFO: `/v3/projects/84bbe7b097cf4b02a2511e0839c95d02/users/327c77db1d2241c7a96036e7eaf51307/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.337273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84bbe7b097cf4b02a2511e0839c95d02, user_id=327c77db1d2241c7a96036e7eaf51307, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:29.339917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:29.355683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1224/2439] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:29 2022] PUT /identity/v3/projects/84bbe7b097cf4b02a2511e0839c95d02/users/327c77db1d2241c7a96036e7eaf51307/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:29.359644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:29.371842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e077eb55-ac0d-444b-b4b2-e8c626cff27a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:29.459960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a138490-ffea-4f89-b11b-afd0deff3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:29.460636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a138490-ffea-4f89-b11b-afd0deff3db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:29.460917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a138490-ffea-4f89-b11b-afd0deff3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:29.461184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a138490-ffea-4f89-b11b-afd0deff3db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.461833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a138490-ffea-4f89-b11b-afd0deff3db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:29.463502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a138490-ffea-4f89-b11b-afd0deff3db1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:29.477233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1216/2440] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:30:29.478652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:29.492061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5aa085-76f5-4ed6-af05-0dcddd344c9e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:29.499515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:29.500189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:29.500493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:29.500755 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] PATH_INFO: `/v3/projects/84bbe7b097cf4b02a2511e0839c95d02/users/327c77db1d2241c7a96036e7eaf51307/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:29.505948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84bbe7b097cf4b02a2511e0839c95d02, user_id=327c77db1d2241c7a96036e7eaf51307, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:29.508813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:29.521814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:29.548554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1225/2441] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:30:29 2022] PUT /identity/v3/projects/84bbe7b097cf4b02a2511e0839c95d02/users/327c77db1d2241c7a96036e7eaf51307/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:30:34.628837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98a4c-9a21-44d6-8ea6-51bb8c52f911 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:34.631724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98a4c-9a21-44d6-8ea6-51bb8c52f911 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:34.632064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98a4c-9a21-44d6-8ea6-51bb8c52f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:34.700981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-44d98a4c-9a21-44d6-8ea6-51bb8c52f911 None None] MFA Rules not processed for user `327c77db1d2241c7a96036e7eaf51307`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:34.702315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-44d98a4c-9a21-44d6-8ea6-51bb8c52f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:34.805350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1217/2442] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:34.813964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:30:34.816536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:34.949355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a83e3-60e8-4a82-8a12-5ce0dcc24ec6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:30:34.956763 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:30:34.957381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:34.958088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:34.958362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:35.028115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:30:35.030019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:30:35.045064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1226/2443] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:30:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:30:36.510431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0417-b56f-43eb-bd06-82baa8c97e8c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:30:36.510934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0417-b56f-43eb-bd06-82baa8c97e8c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:30:36.511074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0417-b56f-43eb-bd06-82baa8c97e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:30:36.533013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-397d0417-b56f-43eb-bd06-82baa8c97e8c None None] MFA Rules not processed for user `72593249ee4843e9bb3ae413bfccf8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:30:36.534665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-397d0417-b56f-43eb-bd06-82baa8c97e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:30:36.543112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1218/2444] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:30:45.035758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=69 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:30:46.527042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=72 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:02.137795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:02.139423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:02.249124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2957f27-9d3d-4ec5-9032-4b6186479b19 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:02.254959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:02.255522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:02.255802 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:02.256120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:02.258036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:02.271085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:02.272706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:02.284185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1227/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:06.082288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec8e4-0168-446a-ac52-36d0d703ed0d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:06.082936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec8e4-0168-446a-ac52-36d0d703ed0d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:06.082936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ec8e4-0168-446a-ac52-36d0d703ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:06.106031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-234ec8e4-0168-446a-ac52-36d0d703ed0d None None] MFA Rules not processed for user `c8982b93df5744bbbdeb7a956df06502`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:06.107233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-234ec8e4-0168-446a-ac52-36d0d703ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:06.177086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1219/2446] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:31:12.279336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=41 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:16.168833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=25 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:23.342889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:23.412537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d3ba6-7ab0-45e9-8307-9e267b5aba1c service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:23.417086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:23.417695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:23.418127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:23.418285 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:23.427712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:23.429700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:23.439193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1228/2447] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:33.435299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=26 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:31:48.599771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:48.600341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:48.600341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:48.631116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:31:48.632309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:48.692654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1220/2448] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:31:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:31:48.742632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:48.744262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:48.823327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adfacb-57ad-46f3-9a28-1b7ddd1125e0 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:48.829103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:48.829715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:48.829983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:48.830250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:48.838851 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:48.840430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:48.848569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1229/2449] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:31:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:31:55.657379 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:55.669089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674694-6f27-45c6-a279-245af8c7528e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:55.673810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:55.674428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:55.674693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:55.674957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:55.677397 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:55.693137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:55.694587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8e500-fe08-413a-8db2-0df027ff59ef service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:55.710222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1221/2450] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:31:56.924412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:31:56.934451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e5192-3c56-4169-9f74-c87ced009f44 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:31:56.938261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:31:56.938874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:31:56.939150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:31:56.939422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:31:56.941357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:31:56.956416 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:31:56.958020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fb3a6-b9a2-43d9-94e2-10f69f53c1ac service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:31:56.972136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1230/2451] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:31:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:05.284455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab4e4e-73c0-4fa1-86c4-4968fd8ad902 None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.285364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab4e4e-73c0-4fa1-86c4-4968fd8ad902 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.285652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab4e4e-73c0-4fa1-86c4-4968fd8ad902 None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.287605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1222/2452] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:32:05.300853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cdd1-a722-4de4-ad6c-ed99bb6b0b43 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.301800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cdd1-a722-4de4-ad6c-ed99bb6b0b43 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.302241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cdd1-a722-4de4-ad6c-ed99bb6b0b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.345386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a584cdd1-a722-4de4-ad6c-ed99bb6b0b43 None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:05.347065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a584cdd1-a722-4de4-ad6c-ed99bb6b0b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:05.358415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1231/2453] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:05.371949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab4e4e-73c0-4fa1-86c4-4968fd8ad902 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:05.374544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a6ab4e4e-73c0-4fa1-86c4-4968fd8ad902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:05.445555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab4e4e-73c0-4fa1-86c4-4968fd8ad902 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:05.449290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3b545-2b28-4a77-91c5-7cb9694c852e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:05.449911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3b545-2b28-4a77-91c5-7cb9694c852e service glance] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.450167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3b545-2b28-4a77-91c5-7cb9694c852e service glance] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.450430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3b545-2b28-4a77-91c5-7cb9694c852e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.467072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3b545-2b28-4a77-91c5-7cb9694c852e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:05.467072 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3b545-2b28-4a77-91c5-7cb9694c852e service glance] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:05.480679 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1223/2454] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:05.555331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1d987-f606-4fa3-a3e5-f0dff7540849 None None] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.555661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1d987-f606-4fa3-a3e5-f0dff7540849 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.555976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1d987-f606-4fa3-a3e5-f0dff7540849 None None] PATH_INFO: `/` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.557340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1232/2455] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:32:05.562834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2dbc8-d102-4696-b3be-e744a8442e44 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.563184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2dbc8-d102-4696-b3be-e744a8442e44 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.563495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2dbc8-d102-4696-b3be-e744a8442e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.584742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b8f2dbc8-d102-4696-b3be-e744a8442e44 None None] MFA Rules not processed for user `9f2b2a5d05b545b28da423e872f47a10`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:05.585953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b8f2dbc8-d102-4696-b3be-e744a8442e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:05.592668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1224/2456] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:05.604685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1d987-f606-4fa3-a3e5-f0dff7540849 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:05.616220 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1d987-f606-4fa3-a3e5-f0dff7540849 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:05.620613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036b58d-aa73-4796-bd4c-bfa4c48b6cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:05.621197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b58d-aa73-4796-bd4c-bfa4c48b6cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.621468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b58d-aa73-4796-bd4c-bfa4c48b6cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.621734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036b58d-aa73-4796-bd4c-bfa4c48b6cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.628661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036b58d-aa73-4796-bd4c-bfa4c48b6cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:05.630071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036b58d-aa73-4796-bd4c-bfa4c48b6cf0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:05.637911 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1233/2457] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:32:05.724083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb806b9-b694-4f89-8444-d45dcd9a0b8d None None] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.724357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb806b9-b694-4f89-8444-d45dcd9a0b8d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.724699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb806b9-b694-4f89-8444-d45dcd9a0b8d None None] PATH_INFO: `/` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.726714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1225/2458] 10.222.0.60 () {54 vars in 921 bytes} [Tue Aug 9 12:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 12:32:05.732148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3b773-5a26-42a1-bef7-3adb911e35cc None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.732456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3b773-5a26-42a1-bef7-3adb911e35cc None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.732735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3b773-5a26-42a1-bef7-3adb911e35cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.753524 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e8d3b773-5a26-42a1-bef7-3adb911e35cc None None] MFA Rules not processed for user `2d6406240f104443b75c8ec7d7999070`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:05.754736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e8d3b773-5a26-42a1-bef7-3adb911e35cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:05.765337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1234/2459] 10.222.0.60 () {58 vars in 1018 bytes} [Tue Aug 9 12:32:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:32:05.781261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb806b9-b694-4f89-8444-d45dcd9a0b8d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:05.793259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb806b9-b694-4f89-8444-d45dcd9a0b8d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:05.797106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:05.797699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:05.797970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:05.798233 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:05.808731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:05.810090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:05.820463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1226/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:08.173314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:08.173825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:08.173825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:08.194568 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:08.195909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:08.203510 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1235/2461] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:32:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:08.218993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:08.234254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a07457-abb0-44d5-8c22-4d6caf9fa375 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:08.240435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfd7ca-3998-4fcf-bbd0-d4f7e70f8101 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:08.241087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd7ca-3998-4fcf-bbd0-d4f7e70f8101 service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:08.241365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd7ca-3998-4fcf-bbd0-d4f7e70f8101 service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:08.241624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfd7ca-3998-4fcf-bbd0-d4f7e70f8101 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:08.250465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd7ca-3998-4fcf-bbd0-d4f7e70f8101 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:08.252028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfd7ca-3998-4fcf-bbd0-d4f7e70f8101 service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:08.260334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1227/2462] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:32:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:18.188735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=59 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:18.257056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=76 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:25.756104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:25.767162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d56f1-995c-4e83-81cb-d63edfa87b83 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:25.771064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:25.771696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:25.771999 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:25.772264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:25.774120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:25.784744 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:25.786159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:25.794731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1236/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:31.820457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:31.820977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:31.820977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:31.871643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:31.872786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:31.895313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1228/2464] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 9 12:32:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:31.908746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:31.931348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090c2a3-b51a-41e2-90b6-d34deaebb44f service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:31.937074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:31.937672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:31.937945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:31.938208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:31.946522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:31.948083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:31.958398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1237/2465] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:32:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:32:41.891871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=18 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:41.953187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=16 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:49.134040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:49.143942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9557f-6ee1-4456-9ebc-789dcdce6ba0 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:49.147826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:49.148470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:49.148739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:49.149004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:49.150884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:49.217419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:49.218851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:49.229408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1229/2466] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:52.500351 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:52.501946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:52.524500 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d582b56-6075-4f1f-83c5-3188fe3a0b51 service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:52.529471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:52.530096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:52.530392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:52.530949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] PATH_INFO: `/v3/users/adadf92bd9ec48dfbb4eb5977edab923` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:52.546347 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adadf92bd9ec48dfbb4eb5977edab923)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:52.548432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:52.608314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adadf92bd9ec48dfbb4eb5977edab923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:52.618005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adadf92bd9ec48dfbb4eb5977edab923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:52.627214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adadf92bd9ec48dfbb4eb5977edab923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:52.627982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adadf92bd9ec48dfbb4eb5977edab923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:52.649660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-68820ca7-66b1-460e-b622-b446bc96341e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adadf92bd9ec48dfbb4eb5977edab923'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:52.656805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1238/2467] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:32:52 2022] DELETE /identity/v3/users/adadf92bd9ec48dfbb4eb5977edab923 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:52.839009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:52.849718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55610-eba3-4946-93fe-56cd15d82867 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:52.930472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:52.931111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:52.931384 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:52.931647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] PATH_INFO: `/v3/projects/47b9057e7d514e6dbe0c358cce79e61a` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:52.942143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b9057e7d514e6dbe0c358cce79e61a)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:52.944074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:52.994996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b9057e7d514e6dbe0c358cce79e61a', 'request_id': 'req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:53.001186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b9057e7d514e6dbe0c358cce79e61a', 'request_id': 'req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:53.008093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b9057e7d514e6dbe0c358cce79e61a', 'request_id': 'req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:53.023885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] The token cache is being invalidate because project 47b9057e7d514e6dbe0c358cce79e61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:32:53.024252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:53.024934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b9e3a0a3-6028-4094-ad2b-92f998a1c64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:53.026744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1230/2468] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:32:52 2022] DELETE /identity/v3/projects/47b9057e7d514e6dbe0c358cce79e61a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:53.031864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.032502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.032746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.054870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:53.056098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:53.115815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1239/2469] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:53.124311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.124638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.124906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.145984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:53.147186 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:53.155613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1231/2470] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:53.159952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.170442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7731-1ec6-44e0-be35-78ff657550ab None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.176226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.176936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.177216 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.177488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.178169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:32:53.178472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.180077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.191895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1240/2471] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:32:53.196251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.205894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5a2ba-e0dd-4a19-acd3-808d12b75586 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.211101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.211689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.211982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.212247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.212886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.214787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.219932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:53.257536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1232/2472] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:32:53 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:53.261780 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.273028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f0902-656a-4946-8674-639326a8bdbb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.318972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:53.333301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.333905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.334214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.334475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.335182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.337179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.359534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1241/2473] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:32:53 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:53.363872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.374927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad1d11-4a86-4133-b380-d66b1b7f8309 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.380875 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.381487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.381756 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.382016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.382630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.384230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.395004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1233/2474] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:53.399130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.409353 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afe83c-0cb4-4c37-b131-143e9eec8943 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.414241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.414835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.415107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.415370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.416002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.417634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.429043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1242/2475] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:53.433678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.445456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d67f4-41a4-4248-8ff8-2bae19bd3c79 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.450696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ee4d2-504f-4d13-9599-d693b5c416ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.451366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee4d2-504f-4d13-9599-d693b5c416ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.451639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee4d2-504f-4d13-9599-d693b5c416ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.451908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee4d2-504f-4d13-9599-d693b5c416ed admin admin] PATH_INFO: `/v3/projects/5449f07abd99492aa8c1a2d4b1cf4529/users/3478d947706947c8af42832965e781df/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.452542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.454638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:53.468001 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ee4d2-504f-4d13-9599-d693b5c416ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5449f07abd99492aa8c1a2d4b1cf4529, user_id=3478d947706947c8af42832965e781df, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.470814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ee4d2-504f-4d13-9599-d693b5c416ed admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.485940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1234/2476] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:53 2022] PUT /identity/v3/projects/5449f07abd99492aa8c1a2d4b1cf4529/users/3478d947706947c8af42832965e781df/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:32:53.498280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.498562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.498838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.526726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] MFA Rules not processed for user `3478d947706947c8af42832965e781df`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:53.527933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:53.544313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a34af-cb7f-4fb5-9a13-84ffa823b515 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.595908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.600743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1235/2477] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:53.600908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.600908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.600908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.600908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:53.607914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.610007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:53.673187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.674881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.684777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1243/2478] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:53.686004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2e376-8f69-446d-b1dc-940872d4ab06 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:53.692651 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32ff42-aced-4224-bc13-4e8e7164b10d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:53.693346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ff42-aced-4224-bc13-4e8e7164b10d service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:53.693689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ff42-aced-4224-bc13-4e8e7164b10d service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:53.694025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32ff42-aced-4224-bc13-4e8e7164b10d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:53.702378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32ff42-aced-4224-bc13-4e8e7164b10d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:53.704079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32ff42-aced-4224-bc13-4e8e7164b10d service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:53.716868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1236/2479] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:53.947864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:53.966791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:54.015157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba499322-e365-4fcb-bac6-22e523b83d80 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:54.020672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:54.021288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.021565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.021829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] PATH_INFO: `/v3/users/3478d947706947c8af42832965e781df` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.022973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3478d947706947c8af42832965e781df)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:54.024899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:54.085280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3478d947706947c8af42832965e781df'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.096652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3478d947706947c8af42832965e781df'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.103617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3478d947706947c8af42832965e781df'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.104234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3478d947706947c8af42832965e781df'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.116269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3478d947706947c8af42832965e781df'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.122571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1244/2480] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:32:53 2022] DELETE /identity/v3/users/3478d947706947c8af42832965e781df => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:54.127439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2021-25e2-467b-9781-427312883848 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.127917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2021-25e2-467b-9781-427312883848 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.128062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2021-25e2-467b-9781-427312883848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.147570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-660d2021-25e2-467b-9781-427312883848 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:54.148823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-660d2021-25e2-467b-9781-427312883848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:54.161710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:54.212579 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1237/2481] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:54.222887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:54.224622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:54.292575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abaddc-a39c-46b1-801e-79ba9d737bc5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:54.297207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc370f-2857-492f-b68c-f8591a404f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:54.297812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc370f-2857-492f-b68c-f8591a404f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.298086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc370f-2857-492f-b68c-f8591a404f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.298361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc370f-2857-492f-b68c-f8591a404f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.307933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc370f-2857-492f-b68c-f8591a404f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:54.309392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc370f-2857-492f-b68c-f8591a404f7f service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:54.319640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1245/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:54.613629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2021-25e2-467b-9781-427312883848 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:54.615067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-660d2021-25e2-467b-9781-427312883848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:54.630142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2021-25e2-467b-9781-427312883848 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:54.635593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:54.636990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.637275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.637688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] PATH_INFO: `/v3/projects/5449f07abd99492aa8c1a2d4b1cf4529` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.638784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5449f07abd99492aa8c1a2d4b1cf4529)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:54.640837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:54.690396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5449f07abd99492aa8c1a2d4b1cf4529', 'request_id': 'req-6b023014-0dd3-4351-a627-d063dacf825e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.695936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5449f07abd99492aa8c1a2d4b1cf4529', 'request_id': 'req-6b023014-0dd3-4351-a627-d063dacf825e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.702014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5449f07abd99492aa8c1a2d4b1cf4529', 'request_id': 'req-6b023014-0dd3-4351-a627-d063dacf825e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.717071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] The token cache is being invalidate because project 5449f07abd99492aa8c1a2d4b1cf4529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:32:54.717353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.718025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6b023014-0dd3-4351-a627-d063dacf825e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:54.719541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1238/2483] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:32:54 2022] DELETE /identity/v3/projects/5449f07abd99492aa8c1a2d4b1cf4529 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:54.724738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.725247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.725247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.745942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:54.747148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:54.781879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:54.808307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1246/2484] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:54.816804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.817090 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.817355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.838171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:54.839360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:54.848842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1239/2485] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:54.854010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:54.867602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad731d9-d9c5-4545-8182-7eb0771af85b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:54.873235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:54.873829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.874103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.874346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.874984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:32:54.875311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:54.877022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:54.889015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1247/2486] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:32:54.893655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:54.903011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787e978-f554-4b7d-9e89-3175d3a4d744 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:54.908028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:54.908692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:54.908987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:54.909246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:54.910089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:54.912132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:54.946600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1240/2487] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:32:54 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:54.952358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:54.964489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b91a-5dc1-442a-977e-1ca8bde8988c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.025799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.026471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.026885 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.027165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.027818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.029824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.052843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1248/2488] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:32:54 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:55.058868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.069703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e1ed4-d7f2-4a09-83e8-e6013c32ff55 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.074569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.075297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.075571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.075833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.076605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.078262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.089075 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1241/2489] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:55.093665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.104670 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bad580-bfcf-4522-af2f-0cd37c289476 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.110321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f18a6-f263-4aae-a9c1-7ff9d33fd797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.111050 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f18a6-f263-4aae-a9c1-7ff9d33fd797 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.111451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f18a6-f263-4aae-a9c1-7ff9d33fd797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.111653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f18a6-f263-4aae-a9c1-7ff9d33fd797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.112274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f18a6-f263-4aae-a9c1-7ff9d33fd797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.113901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f18a6-f263-4aae-a9c1-7ff9d33fd797 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.125099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1249/2490] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:55.129773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.140128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5d141-a22c-4fc6-b2a4-3100f1b1a0f1 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.145095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.145741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.146013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.146282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] PATH_INFO: `/v3/projects/34edad40b1f74ec8a3e9b3777a3be02a/users/52e00ce815a24b289dc643403b6cb28f/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.160951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34edad40b1f74ec8a3e9b3777a3be02a, user_id=52e00ce815a24b289dc643403b6cb28f, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.163584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.178506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1242/2491] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:55 2022] PUT /identity/v3/projects/34edad40b1f74ec8a3e9b3777a3be02a/users/52e00ce815a24b289dc643403b6cb28f/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:55.190403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868b447-17d0-4d02-946b-1709190886ac None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.190685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868b447-17d0-4d02-946b-1709190886ac None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.190955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868b447-17d0-4d02-946b-1709190886ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.218930 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6868b447-17d0-4d02-946b-1709190886ac None None] MFA Rules not processed for user `52e00ce815a24b289dc643403b6cb28f`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:55.220101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6868b447-17d0-4d02-946b-1709190886ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:55.284892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1250/2492] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:55.289643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.330217 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:55.360046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15222716-3d1d-457e-9377-f8cb92749118 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.365450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.366055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.366328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.366583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.367195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.369531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.397939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1243/2493] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:32:55 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:55.403768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868b447-17d0-4d02-946b-1709190886ac None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.421708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868b447-17d0-4d02-946b-1709190886ac None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.459331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:55.492531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.493156 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.493411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.494027 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.494648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.496630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.520193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1251/2494] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:32:55 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:55.524334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.535010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9563a-353d-4f5e-a7af-359b0be98b1f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.539918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.540532 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.540809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.541070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.541724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.543297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.554043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1244/2495] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:55.558672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.571483 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c29e2-b91d-4fab-9ccc-b2482b6485c1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.577880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.578551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.578847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.579176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] PATH_INFO: `/v3/projects/d1b36339f65841d28528c832cfd319bd/users/5a18bb9354094517a33c6491d29a31f6/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.596102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b36339f65841d28528c832cfd319bd, user_id=5a18bb9354094517a33c6491d29a31f6, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.598782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.613564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1252/2496] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:55 2022] PUT /identity/v3/projects/d1b36339f65841d28528c832cfd319bd/users/5a18bb9354094517a33c6491d29a31f6/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:55.617893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.628810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5426c74-6373-4fe1-a2b5-9163cc9bd9d0 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.690581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2555b66-2064-484d-add9-9052ef39783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.691162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555b66-2064-484d-add9-9052ef39783a admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.691435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555b66-2064-484d-add9-9052ef39783a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.691710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2555b66-2064-484d-add9-9052ef39783a admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.692403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555b66-2064-484d-add9-9052ef39783a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.694438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2555b66-2064-484d-add9-9052ef39783a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.704716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1245/2497] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:55.711017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.722144 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c5ba-0657-4707-ba54-ffe5a451253e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.727434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.728048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.728365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.728665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] PATH_INFO: `/v3/projects/d1b36339f65841d28528c832cfd319bd/users/5a18bb9354094517a33c6491d29a31f6/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.730774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1b36339f65841d28528c832cfd319bd, user_id=5a18bb9354094517a33c6491d29a31f6, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.733489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.744868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1253/2498] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:55 2022] PUT /identity/v3/projects/d1b36339f65841d28528c832cfd319bd/users/5a18bb9354094517a33c6491d29a31f6/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:55.755439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.755718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.755984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.788339 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] MFA Rules not processed for user `5a18bb9354094517a33c6491d29a31f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:55.790025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:55.870138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1246/2499] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:55.883680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:55.885698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:55.950162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87811cd-17d5-4e36-8bbd-373a777aec64 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:55.954824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a7f6e-7988-4233-9ce4-86c4c6ab0292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:55.955729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a7f6e-7988-4233-9ce4-86c4c6ab0292 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:55.956136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a7f6e-7988-4233-9ce4-86c4c6ab0292 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:55.956426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a7f6e-7988-4233-9ce4-86c4c6ab0292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:55.966842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a7f6e-7988-4233-9ce4-86c4c6ab0292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:55.968280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a7f6e-7988-4233-9ce4-86c4c6ab0292 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:55.978393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1254/2500] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:56.496016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:56.536639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:56.586597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c633b-e30d-4d65-9ef0-308b5a4cc2cf None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:56.595839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:56.596635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:56.596912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:56.597275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] PATH_INFO: `/v3/users/52e00ce815a24b289dc643403b6cb28f` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:56.598695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e00ce815a24b289dc643403b6cb28f)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:56.600668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:56.670285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e00ce815a24b289dc643403b6cb28f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:56.680489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e00ce815a24b289dc643403b6cb28f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:56.681100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e00ce815a24b289dc643403b6cb28f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:56.695779 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e00ce815a24b289dc643403b6cb28f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:56.696505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e00ce815a24b289dc643403b6cb28f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:56.711846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1247/2501] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:32:56 2022] DELETE /identity/v3/users/52e00ce815a24b289dc643403b6cb28f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:56.721093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:56.721396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:56.721701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:56.753898 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:56.755133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:56.831136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1255/2502] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:32:56.842010 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:56.843662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:56.920454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf8eaa-a7d2-45e2-abb9-866a91f5ef1c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:56.924916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:56.925525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:56.925836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:56.926095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:56.935577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:56.937062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:56.946840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1248/2503] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:57.234270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:57.236273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:57.251048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8665161d-abee-4cc9-ad14-2f97455537a7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:57.261989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:57.262636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:57.262915 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:57.263178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] PATH_INFO: `/v3/projects/34edad40b1f74ec8a3e9b3777a3be02a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:57.264314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34edad40b1f74ec8a3e9b3777a3be02a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:57.266259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:57.303531 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:57.324016 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34edad40b1f74ec8a3e9b3777a3be02a', 'request_id': 'req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.329380 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34edad40b1f74ec8a3e9b3777a3be02a', 'request_id': 'req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.335459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34edad40b1f74ec8a3e9b3777a3be02a', 'request_id': 'req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.351458 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] The token cache is being invalidate because project 34edad40b1f74ec8a3e9b3777a3be02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:32:57.351634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.352287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.353811 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1256/2504] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:32:57 2022] DELETE /identity/v3/projects/34edad40b1f74ec8a3e9b3777a3be02a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:57.358123 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:57.369077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef638960-4560-483f-9416-81483b1885e7 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:57.420214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:57.428228 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:57.428907 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:57.429191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:57.429468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] PATH_INFO: `/v3/users/5a18bb9354094517a33c6491d29a31f6` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:57.430680 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a18bb9354094517a33c6491d29a31f6)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:57.433440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:57.483387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a18bb9354094517a33c6491d29a31f6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.493055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a18bb9354094517a33c6491d29a31f6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.494035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a18bb9354094517a33c6491d29a31f6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.506741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a18bb9354094517a33c6491d29a31f6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.507427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-15b6d6a0-9612-45ea-a862-d58bf40c6a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a18bb9354094517a33c6491d29a31f6'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.519967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1249/2505] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:32:57 2022] DELETE /identity/v3/users/5a18bb9354094517a33c6491d29a31f6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:57.812541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:57.814041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:57.829131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be804d-cedc-4e97-bf37-b5d0f6e8a311 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:57.895805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:57.896523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:57.896797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:57.897187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] PATH_INFO: `/v3/projects/d1b36339f65841d28528c832cfd319bd` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:57.898559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1b36339f65841d28528c832cfd319bd)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:57.900626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:57.950549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1b36339f65841d28528c832cfd319bd', 'request_id': 'req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.956464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1b36339f65841d28528c832cfd319bd', 'request_id': 'req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.962694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1b36339f65841d28528c832cfd319bd', 'request_id': 'req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.976518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] The token cache is being invalidate because project d1b36339f65841d28528c832cfd319bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:32:57.976804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.977452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0b37d29-dce3-489d-bdee-eac8ee1dcd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:32:57.978946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1257/2506] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:32:57 2022] DELETE /identity/v3/projects/d1b36339f65841d28528c832cfd319bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:57.983984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:57.984266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:57.984564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.007080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:58.008329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:58.071943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1250/2507] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:32:58.079877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.080218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.080643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.101061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:58.102284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:58.110872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1258/2508] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:58.115646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.126278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911874ad-5024-4fa6-8c9e-ced4f9b1ad58 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.131611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.132220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.132538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.132802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.133444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:32:58.133740 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.135383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.147647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1251/2509] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:32:58.152721 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.163180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a9705-58bd-43e1-8ca7-f96ce552622f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.168429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.169034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.169305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.170003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.170291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.172203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.211508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1259/2510] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:32:58 2022] POST /identity/v3/projects => generated 353 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:58.215794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.226611 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebcb9a-8115-457c-9bbd-ab33b045f23d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.285126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.285739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.286015 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.286284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.286902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.288859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.297846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:58.317511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1252/2511] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:32:58 2022] POST /identity/v3/users => generated 277 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:32:58.318723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.328899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbc100-7022-4857-b2d7-1a94200819aa admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.333506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.334130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.334402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.334665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.335303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.336917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.346892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1260/2512] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:32:58.351074 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.361960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace0e0e-efca-4827-8b99-cf7a59723d53 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.367086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a916e-3e33-4881-be9b-5e9b885779af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.367699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a916e-3e33-4881-be9b-5e9b885779af admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.367976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a916e-3e33-4881-be9b-5e9b885779af admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.368463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a916e-3e33-4881-be9b-5e9b885779af admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.369268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a916e-3e33-4881-be9b-5e9b885779af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.370908 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a916e-3e33-4881-be9b-5e9b885779af admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.383818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1253/2513] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:58.388067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.395907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:58.400182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d6f1b-2174-4a9a-a336-e81c5868181f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.408258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.409449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.409449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.409772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] PATH_INFO: `/v3/projects/acbc8892ec0f40779545464742b0ae28/users/de988cbf0ca14e178c56bbb418dcf4f8/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.430974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbc8892ec0f40779545464742b0ae28, user_id=de988cbf0ca14e178c56bbb418dcf4f8, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.433654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.448669 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1261/2514] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:58 2022] PUT /identity/v3/projects/acbc8892ec0f40779545464742b0ae28/users/de988cbf0ca14e178c56bbb418dcf4f8/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:58.460418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.460713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.460976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.488788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] MFA Rules not processed for user `de988cbf0ca14e178c56bbb418dcf4f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:58.490011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:58.562088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1254/2515] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:58.567737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.632340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555e751-b2d4-4dad-be33-f4775edc10c5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.637022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.637620 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.637892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.638157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.638770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.640833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.673249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1262/2516] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:32:58 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:58.677996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.689852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fe825-0dfa-46f8-aa6b-e3defaa68040 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.753229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.753838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.754141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.754374 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.754995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.756966 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.779526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1255/2517] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:32:58 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:32:58.783760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.795152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc03b9-1c28-43cf-8611-a5f3b7284ce1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.801966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.802570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.802842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.803101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.803734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.805375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.817012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1263/2518] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:58.821495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.831739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f37c0-7c4b-47b6-80a5-d64f915094da admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.836842 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.837505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.837812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.838081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] PATH_INFO: `/v3/projects/f70c5fa374364e63b1c611f61ef562c7/users/08796acd3e674895ba644d8d652f8eb6/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.852858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70c5fa374364e63b1c611f61ef562c7, user_id=08796acd3e674895ba644d8d652f8eb6, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.855508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.870541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1256/2519] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:58 2022] PUT /identity/v3/projects/f70c5fa374364e63b1c611f61ef562c7/users/08796acd3e674895ba644d8d652f8eb6/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:58.874646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.889960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957cc3c-434e-4748-85dd-ec7a2e62c064 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.946969 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709650d9-bf00-4935-9d97-11ffa902cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.947495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709650d9-bf00-4935-9d97-11ffa902cef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.947768 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709650d9-bf00-4935-9d97-11ffa902cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.948033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709650d9-bf00-4935-9d97-11ffa902cef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.948694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709650d9-bf00-4935-9d97-11ffa902cef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.950311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709650d9-bf00-4935-9d97-11ffa902cef7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.960550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1264/2520] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:32:58.965104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:58.975988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf974375-6fe1-4012-9793-20b0471530a3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:58.980664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:58.981308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:58.981584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:58.981850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] PATH_INFO: `/v3/projects/f70c5fa374364e63b1c611f61ef562c7/users/08796acd3e674895ba644d8d652f8eb6/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:58.983758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f70c5fa374364e63b1c611f61ef562c7, user_id=08796acd3e674895ba644d8d652f8eb6, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:58.987016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:58.997284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1257/2521] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:32:58 2022] PUT /identity/v3/projects/f70c5fa374364e63b1c611f61ef562c7/users/08796acd3e674895ba644d8d652f8eb6/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:32:59.008132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06870721-7991-4929-b812-c42f10935027 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:59.008442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06870721-7991-4929-b812-c42f10935027 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:59.008717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06870721-7991-4929-b812-c42f10935027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:59.036804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-06870721-7991-4929-b812-c42f10935027 None None] MFA Rules not processed for user `08796acd3e674895ba644d8d652f8eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:32:59.038020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-06870721-7991-4929-b812-c42f10935027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:59.076836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:59.106033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1265/2522] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:32:59.118853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:59.120955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:32:59.148719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:32:59.188658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27f05d-6ae1-49ae-a01d-3ef12dbcdad0 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:59.192965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6782bb-150c-4b34-af55-fa23705d653f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:59.193569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6782bb-150c-4b34-af55-fa23705d653f service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:59.193864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6782bb-150c-4b34-af55-fa23705d653f service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:59.194131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6782bb-150c-4b34-af55-fa23705d653f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:59.203179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6782bb-150c-4b34-af55-fa23705d653f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:59.204540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6782bb-150c-4b34-af55-fa23705d653f service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:59.216534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1258/2523] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:32:59.295916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06870721-7991-4929-b812-c42f10935027 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:32:59.305711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06870721-7991-4929-b812-c42f10935027 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:32:59.309556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:32:59.310183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:32:59.310457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:32:59.310711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:32:59.379236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:32:59.380714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:32:59.390054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1266/2524] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:04.861910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:04.862425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:04.862425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:04.887766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] MFA Rules not processed for user `50fa6727271142eba979bb4562a2b853`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:04.889018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:04.949377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1259/2525] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:05.826427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:05.827884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:05.912274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdd8bf-a00b-460e-b58b-98f099045d92 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:05.917200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:05.917806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:05.918078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:05.918342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:05.920031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:05.931437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:05.933040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:05.942805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1267/2526] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:14.622197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:14.623696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:14.682111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082dbc4-12aa-4d98-b13b-1d12c6d0d617 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:14.686509 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:14.687119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:14.687393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:14.687657 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:14.689658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:14.758886 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:14.760336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a2023-662e-44d9-85ae-809d19fe2a6f service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:14.770179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1260/2527] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:15.938697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=71 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:16.894145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:16.906296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c8f7a-023a-4742-b001-c153117f63df service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:16.911300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:16.912134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:16.912427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:16.912578 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] PATH_INFO: `/v3/users/de988cbf0ca14e178c56bbb418dcf4f8` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:16.913713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de988cbf0ca14e178c56bbb418dcf4f8)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:16.916912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:16.973431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de988cbf0ca14e178c56bbb418dcf4f8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:16.982403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de988cbf0ca14e178c56bbb418dcf4f8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:16.990381 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de988cbf0ca14e178c56bbb418dcf4f8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:16.991090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de988cbf0ca14e178c56bbb418dcf4f8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.004177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de988cbf0ca14e178c56bbb418dcf4f8'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.011110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1268/2528] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:16 2022] DELETE /identity/v3/users/de988cbf0ca14e178c56bbb418dcf4f8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:17.015648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:17.016195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:17.016355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:17.037943 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:17.039464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:17.058203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:17.105975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1261/2529] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:33:17.116671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:17.119266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:17.184180 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ed256-fd39-48e1-9c7e-9380c94a9921 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:17.188414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:17.189219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:17.189655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:17.189918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:17.201490 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:17.202926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:17.214123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1269/2530] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:17.505653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:17.508076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:17.541071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fb25c-4c73-48ce-a704-ae42c62536ea None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:17.547483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:17.548463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:17.548975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:17.549330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] PATH_INFO: `/v3/projects/acbc8892ec0f40779545464742b0ae28` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:17.550914 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbc8892ec0f40779545464742b0ae28)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:17.553302 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:17.609958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbc8892ec0f40779545464742b0ae28', 'request_id': 'req-a75e6d89-fc49-4932-93ce-3916b422e89f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.616855 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbc8892ec0f40779545464742b0ae28', 'request_id': 'req-a75e6d89-fc49-4932-93ce-3916b422e89f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.623708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbc8892ec0f40779545464742b0ae28', 'request_id': 'req-a75e6d89-fc49-4932-93ce-3916b422e89f'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.638093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] The token cache is being invalidate because project acbc8892ec0f40779545464742b0ae28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:17.641225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.641628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.644834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1262/2531] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:17 2022] DELETE /identity/v3/projects/acbc8892ec0f40779545464742b0ae28 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:17.647466 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:17.657474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649356a-6a5f-427e-8f02-16f5c2b01416 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:17.715261 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:17.715900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:17.716175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:17.716477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] PATH_INFO: `/v3/users/08796acd3e674895ba644d8d652f8eb6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:17.717615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08796acd3e674895ba644d8d652f8eb6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:17.719640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:17.735649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:17.771164 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08796acd3e674895ba644d8d652f8eb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.782171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08796acd3e674895ba644d8d652f8eb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.789937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08796acd3e674895ba644d8d652f8eb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.790600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08796acd3e674895ba644d8d652f8eb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.804565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-ab5aa511-c43f-4a1c-b4fb-89c913c2db78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08796acd3e674895ba644d8d652f8eb6'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:17.810685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1270/2532] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:17 2022] DELETE /identity/v3/users/08796acd3e674895ba644d8d652f8eb6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:18.143033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.144584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:18.159157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e6d89-fc49-4932-93ce-3916b422e89f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.223818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.224492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.224777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.225040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] PATH_INFO: `/v3/projects/f70c5fa374364e63b1c611f61ef562c7` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.226351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f70c5fa374364e63b1c611f61ef562c7)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.228303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.281130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:18.282278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f70c5fa374364e63b1c611f61ef562c7', 'request_id': 'req-b411be25-0785-4c61-ac12-1619bca5c4fb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:18.289898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f70c5fa374364e63b1c611f61ef562c7', 'request_id': 'req-b411be25-0785-4c61-ac12-1619bca5c4fb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:18.297617 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f70c5fa374364e63b1c611f61ef562c7', 'request_id': 'req-b411be25-0785-4c61-ac12-1619bca5c4fb'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:18.315064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] The token cache is being invalidate because project f70c5fa374364e63b1c611f61ef562c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:18.315606 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:18.316359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-b411be25-0785-4c61-ac12-1619bca5c4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:18.318039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1263/2533] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:18 2022] DELETE /identity/v3/projects/f70c5fa374364e63b1c611f61ef562c7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:18.323547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.324092 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.324347 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.345387 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:18.346758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:18.421262 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1271/2534] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:18.424959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.425309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.425638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.446483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:18.447763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:18.455781 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1264/2535] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:18.460685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.473429 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eaf06-5027-4ed5-becd-7470a7bb4a9e None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.478118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.478950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.479375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.479690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.483408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:18.483724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.485397 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.500078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1272/2536] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:33:18.505153 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.515722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bf017-413f-4d3d-8a32-6f1f5b318eea None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.521098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.523088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.523455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.523849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.524857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.527059 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.572448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1265/2537] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:18 2022] POST /identity/v3/projects => generated 393 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:18.576782 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.589291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2c858-bd2c-4a81-8d31-76ce509fc9bb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.670143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.670849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.671245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.671535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.672331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.674411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.704546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1273/2538] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:18 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:18.706641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.723672 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7cfee-e213-4006-b304-c35e8f8a4ee6 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.733687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.734324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.734601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.734868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.735523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.737223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.751199 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1266/2539] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:18.755287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.766405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca01b5-e9f3-445b-8b4e-c6d0479cd432 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.772417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae2dcc-d7c4-4088-b830-c0dad61d01ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.773102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2dcc-d7c4-4088-b830-c0dad61d01ba admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.773391 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2dcc-d7c4-4088-b830-c0dad61d01ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.774433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae2dcc-d7c4-4088-b830-c0dad61d01ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.775173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae2dcc-d7c4-4088-b830-c0dad61d01ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.776947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae2dcc-d7c4-4088-b830-c0dad61d01ba admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.783546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:18.791773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1274/2540] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:18.795995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:18.807897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13362044-9f2e-43f4-831b-8e9a4c867298 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:18.813334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:18.814108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.814758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.814758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] PATH_INFO: `/v3/projects/9f90cad3cb994783914453ed9d7655f6/users/9bab1933ff7e41769c7864c1576ec932/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.831742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f90cad3cb994783914453ed9d7655f6, user_id=9bab1933ff7e41769c7864c1576ec932, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:18.834575 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:18.851564 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1267/2541] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:18 2022] PUT /identity/v3/projects/9f90cad3cb994783914453ed9d7655f6/users/9bab1933ff7e41769c7864c1576ec932/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:18.862049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:18.862334 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:18.862607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:18.902794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] MFA Rules not processed for user `9bab1933ff7e41769c7864c1576ec932`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:18.904037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:18.985427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1275/2542] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:33:18.989772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.058857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b862955-0b17-4baa-9077-f63bdc9b4010 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.063539 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.064177 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.064558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.064829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.065453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.067359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.101876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1268/2543] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:18 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:19.102491 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.113622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc00469-da0c-4448-bfbf-ee7689482383 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.172283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.174041 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.181560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.182203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.182475 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.182739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.183367 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.185331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.211872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1276/2544] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:19 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:19.213048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.223171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60582ca-4866-4ce1-8492-418566b7ced9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.228181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.228902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.229181 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.229447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.230074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.231703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.245048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1277/2545] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:33:19.246425 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.249462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:19.255122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e9524-f2be-4cee-a934-6a9b7f228e9f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.257503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca8778-3828-4200-9a74-e87cfacd7bdd admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.261744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.262652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.263049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.263329 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.263741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.263975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] PATH_INFO: `/v3/users/c8982b93df5744bbbdeb7a956df06502` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.264105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.264279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] PATH_INFO: `/v3/projects/f5b7cd295ddd46b28914578317db9f0b/users/6071e4eadf244575a0971cdffb3743aa/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.280800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8982b93df5744bbbdeb7a956df06502)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.282238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7cd295ddd46b28914578317db9f0b, user_id=6071e4eadf244575a0971cdffb3743aa, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.283429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.284948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.302055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1278/2546] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:19 2022] PUT /identity/v3/projects/f5b7cd295ddd46b28914578317db9f0b/users/6071e4eadf244575a0971cdffb3743aa/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:19.307065 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.345967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8982b93df5744bbbdeb7a956df06502'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.357765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8982b93df5744bbbdeb7a956df06502'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.358473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8982b93df5744bbbdeb7a956df06502'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.361049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:19.375165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8982b93df5744bbbdeb7a956df06502'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.376004 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8982b93df5744bbbdeb7a956df06502'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.383372 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ecc10-64dc-4791-af83-eb4b2d772dbe admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.388293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84c45-5abe-4a35-a659-7224fa610431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.388992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84c45-5abe-4a35-a659-7224fa610431 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.389330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84c45-5abe-4a35-a659-7224fa610431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.389663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84c45-5abe-4a35-a659-7224fa610431 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.390370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84c45-5abe-4a35-a659-7224fa610431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.391773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1269/2547] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:19 2022] DELETE /identity/v3/users/c8982b93df5744bbbdeb7a956df06502 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:19.392827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84c45-5abe-4a35-a659-7224fa610431 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.404688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1279/2548] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:19.408884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.410591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.484402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acbcea-30d6-4957-aeaf-caa24723eb2b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.489126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.489795 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.490114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.490401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] PATH_INFO: `/v3/projects/f5b7cd295ddd46b28914578317db9f0b/users/6071e4eadf244575a0971cdffb3743aa/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.492345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b7cd295ddd46b28914578317db9f0b, user_id=6071e4eadf244575a0971cdffb3743aa, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.495457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.507343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1270/2549] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:19 2022] PUT /identity/v3/projects/f5b7cd295ddd46b28914578317db9f0b/users/6071e4eadf244575a0971cdffb3743aa/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:19.520922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.521434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.521878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.556691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] MFA Rules not processed for user `6071e4eadf244575a0971cdffb3743aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:19.558004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.602166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.605106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.640446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1280/2550] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:19.653422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.654843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.706563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:19.711568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe8f91-adab-488b-9413-647a1b3dadab admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.718892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.719721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.720554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.721345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] PATH_INFO: `/v3/projects/cffa9ae943de44bc8264914e39c80cfa` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.736800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffa9ae943de44bc8264914e39c80cfa)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.738753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.740522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482ceb7-f032-496a-a7ba-5f282b61754c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.745126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.747249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.747542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.747816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.758410 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.759861 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.770554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1281/2551] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:33:19.795121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffa9ae943de44bc8264914e39c80cfa', 'request_id': 'req-961ef1b7-75db-46d5-a1d2-3b4eeda88165'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.800850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffa9ae943de44bc8264914e39c80cfa', 'request_id': 'req-961ef1b7-75db-46d5-a1d2-3b4eeda88165'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.807816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffa9ae943de44bc8264914e39c80cfa', 'request_id': 'req-961ef1b7-75db-46d5-a1d2-3b4eeda88165'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.822614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] The token cache is being invalidate because project cffa9ae943de44bc8264914e39c80cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:19.822772 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.822917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.823560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-961ef1b7-75db-46d5-a1d2-3b4eeda88165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:19.824596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.825105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1271/2552] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:19 2022] DELETE /identity/v3/projects/cffa9ae943de44bc8264914e39c80cfa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:19.829767 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aae10-8810-4beb-a2e0-23e76866e4a7 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.830118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aae10-8810-4beb-a2e0-23e76866e4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.830480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4aae10-8810-4beb-a2e0-23e76866e4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.846179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd31e1a-70f3-43aa-97c8-f409b8366370 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.851236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1e4aae10-8810-4beb-a2e0-23e76866e4a7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:19.852478 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1e4aae10-8810-4beb-a2e0-23e76866e4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.899246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.899879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.900152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.900469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.902249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.921625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1272/2553] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:19.930044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.930730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:19.931087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.931525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.954104 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:19.955320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:19.963980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1273/2554] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:19.968072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.969018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:19.969903 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:19.979388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e62b3-bf00-4c7c-8012-1f075e2a5f61 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:19.984608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1282/2555] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:33:19.985182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:19.985790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:19.986060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:19.986361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:19.987213 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:19.987518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:19.989259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.004430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1274/2556] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:33:20.008124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.023029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c1f0-9dbb-401c-9fe6-44a6d97a764a service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.028710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.029788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.030197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.030478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.031102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.033685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.066759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1283/2557] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:20 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:20.071263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.083506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c35ed2-0ebe-434b-bdbe-e904eff6176f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.145739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.146786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.147301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.147582 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.148209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.150203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.159209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:20.176770 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1275/2558] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:20 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:20.181077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.191905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c35a6b-c5b4-48ea-bf7a-3864d420ca58 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.197171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.197684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.197964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.198237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.198965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.200503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.213422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1284/2559] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:20.217807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.233744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0a853-a462-47f0-a7e4-315fe243216e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.238555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923e545-35da-4d73-b38d-590f9eb53bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.239202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e545-35da-4d73-b38d-590f9eb53bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.239481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e545-35da-4d73-b38d-590f9eb53bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.239750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923e545-35da-4d73-b38d-590f9eb53bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.240450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923e545-35da-4d73-b38d-590f9eb53bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.242056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923e545-35da-4d73-b38d-590f9eb53bfa admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.257498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1276/2560] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:20.258419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.271691 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e6e06-4133-4161-9b2c-dfe8b98e2fdb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.276968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.277804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.278221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.278583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] PATH_INFO: `/v3/projects/c0e0ccd1c0784552b3f44e89dae52874/users/a46e67325360439ea966e5a6649b27f2/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.295152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e0ccd1c0784552b3f44e89dae52874, user_id=a46e67325360439ea966e5a6649b27f2, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.297859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.314733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1285/2561] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:20 2022] PUT /identity/v3/projects/c0e0ccd1c0784552b3f44e89dae52874/users/a46e67325360439ea966e5a6649b27f2/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:20.325719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.326009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.326290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.356448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] MFA Rules not processed for user `a46e67325360439ea966e5a6649b27f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:20.357710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:20.427958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1277/2562] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:20.433135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.505716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d50584-3abf-4597-a7a7-67568c483061 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.511008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.511605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.511875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.512146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.512781 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.514693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.544944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1286/2563] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:20 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:20.550686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.562334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320508e-e4c4-4329-821c-4c559891d549 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.624244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.624877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.625149 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.625412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.626026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.627952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.652390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1278/2564] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:20 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:20.656575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.668046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9dd80-09fb-40bb-b6ac-ee8de6e616f3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.674535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.675133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.675409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.675677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.676317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.678082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.689765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1287/2565] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:20.694201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.705092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49b493-bab5-44fa-b77c-a9b16779b582 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.711110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.711753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.712033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.712305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] PATH_INFO: `/v3/projects/f53f327be0114495b08829d40939e2da/users/e3690993fdce4a80a98b9d9478f3bc75/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.728613 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53f327be0114495b08829d40939e2da, user_id=e3690993fdce4a80a98b9d9478f3bc75, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.731292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.747013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1279/2566] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:20 2022] PUT /identity/v3/projects/f53f327be0114495b08829d40939e2da/users/e3690993fdce4a80a98b9d9478f3bc75/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:20.751081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.762029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0efcb20-4773-4f08-9e3e-68a8a8c82e5a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.810184 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:20.832058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760adac-ad47-4cdc-9367-5717ad5a1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.832789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760adac-ad47-4cdc-9367-5717ad5a1ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.833128 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760adac-ad47-4cdc-9367-5717ad5a1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.833459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760adac-ad47-4cdc-9367-5717ad5a1ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.834151 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760adac-ad47-4cdc-9367-5717ad5a1ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.835931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760adac-ad47-4cdc-9367-5717ad5a1ec1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.850097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1288/2567] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:20.854044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:20.866210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb514a8-f0f9-42c6-b886-55792a07b639 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:20.875996 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:20.876710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.876990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.877262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] PATH_INFO: `/v3/projects/f53f327be0114495b08829d40939e2da/users/e3690993fdce4a80a98b9d9478f3bc75/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.879268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f53f327be0114495b08829d40939e2da, user_id=e3690993fdce4a80a98b9d9478f3bc75, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:20.885601 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:20.894088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1280/2568] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:20 2022] PUT /identity/v3/projects/f53f327be0114495b08829d40939e2da/users/e3690993fdce4a80a98b9d9478f3bc75/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:20.906733 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:20.907099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:20.907541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:20.939393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] MFA Rules not processed for user `e3690993fdce4a80a98b9d9478f3bc75`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:20.940685 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:21.012241 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1289/2569] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:21.024608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:21.026490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:21.049652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:21.088211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e3575-1e18-471d-b922-74d17df53f98 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:21.092604 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:21.093227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:21.093494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:21.093753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:21.103271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:21.104715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:21.113924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1281/2570] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:21.197348 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:21.211188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352a0b8-901d-4d1e-a847-b701f35d5063 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:21.217989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:21.218868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:21.219219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:21.219464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:21.295097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:21.296572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:21.306729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1290/2571] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:21.474542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:21.476628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:21.563537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f93e7a-0953-4fed-916a-8d91cae25e0c service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:21.569023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:21.569675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:21.569952 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:21.570223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:21.571958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:21.585761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:21.587366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c181e-dae9-46ff-9136-3aba4c934c15 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:21.598054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1282/2572] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:23.457909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:23.459481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:23.528244 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359b9c2-1834-4add-a761-f4a0b8b2ecbb service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:23.533538 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:23.534157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:23.534428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:23.534690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] PATH_INFO: `/v3/users/9bab1933ff7e41769c7864c1576ec932` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:23.535814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bab1933ff7e41769c7864c1576ec932)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:23.537762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:23.539665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:23.593824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bab1933ff7e41769c7864c1576ec932'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:23.603973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bab1933ff7e41769c7864c1576ec932'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:23.612654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bab1933ff7e41769c7864c1576ec932'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:23.613430 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bab1933ff7e41769c7864c1576ec932'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:23.626905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bab1933ff7e41769c7864c1576ec932'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:23.632974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1291/2573] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:23 2022] DELETE /identity/v3/users/9bab1933ff7e41769c7864c1576ec932 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:23.637994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:23.638491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:23.638640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:23.658955 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:23.660158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:23.728957 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1283/2574] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:23.743022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:23.744947 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:23.808417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98d8c-11a9-4451-a573-dc57721d9d8f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:23.812895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:23.813507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:23.813785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:23.814043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:23.823716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:23.825186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:23.834770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1292/2575] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:24.112703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.114251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.127859 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdaec5-d1c7-4b6d-82e6-08098bcf4842 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.135803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:24.136619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.136912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.137244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] PATH_INFO: `/v3/users/a46e67325360439ea966e5a6649b27f2` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.138463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46e67325360439ea966e5a6649b27f2)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:24.140587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:24.146629 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.148072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.161319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226649f-d5cc-4cd4-b8ce-9f16713e8654 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.166954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:24.167798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.168138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.168502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] PATH_INFO: `/v3/projects/9f90cad3cb994783914453ed9d7655f6` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.170267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f90cad3cb994783914453ed9d7655f6)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:24.172243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:24.196829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:24.201508 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46e67325360439ea966e5a6649b27f2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.213043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46e67325360439ea966e5a6649b27f2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.213904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46e67325360439ea966e5a6649b27f2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.225806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f90cad3cb994783914453ed9d7655f6', 'request_id': 'req-4f5bf437-47ba-4737-ae1c-5ee78185c360'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.226253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46e67325360439ea966e5a6649b27f2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.227033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ad81df88-bcae-4795-be6d-f3e2e4c24305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46e67325360439ea966e5a6649b27f2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.232213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f90cad3cb994783914453ed9d7655f6', 'request_id': 'req-4f5bf437-47ba-4737-ae1c-5ee78185c360'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.240130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1284/2576] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:24 2022] DELETE /identity/v3/users/a46e67325360439ea966e5a6649b27f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:24.241070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f90cad3cb994783914453ed9d7655f6', 'request_id': 'req-4f5bf437-47ba-4737-ae1c-5ee78185c360'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.245218 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.245635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.245922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.256711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] The token cache is being invalidate because project 9f90cad3cb994783914453ed9d7655f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:24.257083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.257906 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.259810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1293/2577] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:24 2022] DELETE /identity/v3/projects/9f90cad3cb994783914453ed9d7655f6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:24.263883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.265264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.267016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:24.268185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.271264 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:24.331553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf437-47ba-4737-ae1c-5ee78185c360 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.337168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:24.337682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1285/2578] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:33:24.341559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.341559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.341824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] PATH_INFO: `/v3/users/6071e4eadf244575a0971cdffb3743aa` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.343032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6071e4eadf244575a0971cdffb3743aa)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:24.345063 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:24.347737 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.349203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.403574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6071e4eadf244575a0971cdffb3743aa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.415702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6071e4eadf244575a0971cdffb3743aa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.423079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534361d-eeda-4190-8b20-13a1dfa44e2c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.424457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6071e4eadf244575a0971cdffb3743aa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.425236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6071e4eadf244575a0971cdffb3743aa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.427979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:24.428761 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.429136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.429502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.431548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.440288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6071e4eadf244575a0971cdffb3743aa'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.443998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:24.445660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:24.448649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1294/2579] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:24 2022] DELETE /identity/v3/users/6071e4eadf244575a0971cdffb3743aa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:24.457816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1286/2580] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:33:24.740655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.742136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.793272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.795390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.807776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0a01-7576-4e79-9f03-89d4ce8854a6 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.815024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b95f5-bc8b-4608-a57e-bda4b36c7db7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.820226 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:24.821252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.821792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.822987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.825043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.887469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:24.893565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:24.894677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.895019 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.895507 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] PATH_INFO: `/v3/projects/f5b7cd295ddd46b28914578317db9f0b` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:24.897562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b7cd295ddd46b28914578317db9f0b)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:24.899782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:24.906877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:24.915700 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:24.917120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:24.928600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1295/2581] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:24.929370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:24.930803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:24.949913 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317dd0f-b99c-4a4f-a4ab-3fcb0e341ad9 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:24.951968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b7cd295ddd46b28914578317db9f0b', 'request_id': 'req-6d97e801-ba87-4472-85b8-637860e19674'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.957964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b7cd295ddd46b28914578317db9f0b', 'request_id': 'req-6d97e801-ba87-4472-85b8-637860e19674'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.965976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b7cd295ddd46b28914578317db9f0b', 'request_id': 'req-6d97e801-ba87-4472-85b8-637860e19674'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.984268 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] The token cache is being invalidate because project f5b7cd295ddd46b28914578317db9f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:24.984895 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.986265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-6d97e801-ba87-4472-85b8-637860e19674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:24.988369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1287/2582] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:24 2022] DELETE /identity/v3/projects/f5b7cd295ddd46b28914578317db9f0b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:24.993631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2589c-ab90-4692-9dc1-0392fefa1166 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:24.994490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2589c-ab90-4692-9dc1-0392fefa1166 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:24.995043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2589c-ab90-4692-9dc1-0392fefa1166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.017536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.018183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.018461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.018731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] PATH_INFO: `/v3/projects/c0e0ccd1c0784552b3f44e89dae52874` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.018878 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-67b2589c-ab90-4692-9dc1-0392fefa1166 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:25.019883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e0ccd1c0784552b3f44e89dae52874)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.020137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-67b2589c-ab90-4692-9dc1-0392fefa1166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.022174 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.032451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1288/2583] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:25.037837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.038121 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.038391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.060552 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:25.061758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.080099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e0ccd1c0784552b3f44e89dae52874', 'request_id': 'req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.088804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e0ccd1c0784552b3f44e89dae52874', 'request_id': 'req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.096857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e0ccd1c0784552b3f44e89dae52874', 'request_id': 'req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.112976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] The token cache is being invalidate because project c0e0ccd1c0784552b3f44e89dae52874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:25.113359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.114111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.115712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1296/2584] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:24 2022] DELETE /identity/v3/projects/c0e0ccd1c0784552b3f44e89dae52874 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:25.120175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.121711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.134846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1289/2585] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:33:25.138366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.147936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc07a0-e74b-4ac3-ba36-e91fc36cb972 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.153535 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.154151 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.154719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.154719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.155319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:25.155730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.157278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.170189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1290/2586] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:33:25.174451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.185383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5357fa-1238-44e1-a45f-4e1df881e792 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.190341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.191050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.191252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.191642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.192489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.194435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.198230 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965f946-fdb5-4c3c-a3e9-7fa5865f2f95 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.203786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.204831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.205157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.205356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] PATH_INFO: `/v3/users/e3690993fdce4a80a98b9d9478f3bc75` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.206523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3690993fdce4a80a98b9d9478f3bc75)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.208522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.216199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:25.230840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1291/2587] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:25 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:33:25.234973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.269619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3690993fdce4a80a98b9d9478f3bc75'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.280759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3690993fdce4a80a98b9d9478f3bc75'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.290687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3690993fdce4a80a98b9d9478f3bc75'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.291584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3690993fdce4a80a98b9d9478f3bc75'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.292264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:25.303450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e70f94-822d-417f-9dd7-10ff998ae010 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.310468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.310653 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3690993fdce4a80a98b9d9478f3bc75'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.311528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.311528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.311739 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.312912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.315259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.317617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1297/2588] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:25 2022] DELETE /identity/v3/users/e3690993fdce4a80a98b9d9478f3bc75 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:25.340607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1292/2589] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:25 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:33:25.344952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.346507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.424252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b8151-f7b6-49e0-a9b9-06ec75d25582 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.429089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.429751 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.430023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.430291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.430938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.432692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.444366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1298/2590] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:33:25.448621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.460359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57fc00-5a4b-4a9b-8ee4-765341f198e8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.465989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b451985-6f25-4511-b4f8-6e99a1bfdc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.466634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451985-6f25-4511-b4f8-6e99a1bfdc1e admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.467278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451985-6f25-4511-b4f8-6e99a1bfdc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.467278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b451985-6f25-4511-b4f8-6e99a1bfdc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.467874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b451985-6f25-4511-b4f8-6e99a1bfdc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.469614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b451985-6f25-4511-b4f8-6e99a1bfdc1e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.481277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1293/2591] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:33:25.485566 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.498398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad86d1-2fc8-4a89-a4b3-18aa654b7031 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.503545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.504228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.504556 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.504833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] PATH_INFO: `/v3/projects/563a3d0d05924f9baf6d429f6d4f4b83/users/b7671595f2ad44bd9fda400a96bc3605/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.522440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563a3d0d05924f9baf6d429f6d4f4b83, user_id=b7671595f2ad44bd9fda400a96bc3605, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.525424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.547605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1299/2592] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:25 2022] PUT /identity/v3/projects/563a3d0d05924f9baf6d429f6d4f4b83/users/b7671595f2ad44bd9fda400a96bc3605/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:25.558347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.558915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.560081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.596724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] MFA Rules not processed for user `b7671595f2ad44bd9fda400a96bc3605`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:25.597935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.638844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.640657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.700108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1294/2593] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:33:25.712694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.714426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.727682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:25.733710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ba531-00fa-4cf2-9ce2-3bb799160b20 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.740599 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.743384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.744369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.744591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] PATH_INFO: `/v3/projects/f53f327be0114495b08829d40939e2da` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.746729 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f53f327be0114495b08829d40939e2da)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.749294 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.791797 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836237a3-d793-4780-90f2-f94bc25c0762 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:25.796018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9eff15-218f-4deb-bc58-8bd932073bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:25.796862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eff15-218f-4deb-bc58-8bd932073bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.797138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eff15-218f-4deb-bc58-8bd932073bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.797434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9eff15-218f-4deb-bc58-8bd932073bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.807556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eff15-218f-4deb-bc58-8bd932073bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:25.809342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9eff15-218f-4deb-bc58-8bd932073bfc service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:25.810085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f53f327be0114495b08829d40939e2da', 'request_id': 'req-f6ffb698-995c-4e5a-8797-4c15df6fc685'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.816526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f53f327be0114495b08829d40939e2da', 'request_id': 'req-f6ffb698-995c-4e5a-8797-4c15df6fc685'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.819746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1295/2594] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:33:25.824509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f53f327be0114495b08829d40939e2da', 'request_id': 'req-f6ffb698-995c-4e5a-8797-4c15df6fc685'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.842369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] The token cache is being invalidate because project f53f327be0114495b08829d40939e2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:25.842760 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.843522 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f6ffb698-995c-4e5a-8797-4c15df6fc685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:25.845200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1300/2595] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:25 2022] DELETE /identity/v3/projects/f53f327be0114495b08829d40939e2da => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:25.851810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.852091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.852350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.875521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:25.876868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.947836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1296/2596] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:25.956405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:25.956405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:25.956405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:25.976931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:25.978677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:25.987895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1301/2597] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:25.991938 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:25.999270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:26.003361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb977232-35fc-4e95-adac-196dccd74973 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.010112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.010983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.011789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.011789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.012338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:26.012670 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.014416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.026811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1297/2598] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:33:26.031390 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:26.041548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b4f27-8837-438b-9526-53afd04ef289 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.047492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.048289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.048452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.048785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.049415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.051344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.086794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1302/2599] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:26 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:26.091070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:26.103904 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891da39-8cee-4773-a1bd-4a825e47eb1d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.183475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.184416 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.184845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.185280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.186106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.188702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.226207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1298/2600] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:26 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:26.230812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:26.241949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423b6c5-879b-4826-b2e1-d2f8a870bc46 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.247470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.248185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.248649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.249011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.249750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.251532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.262662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1303/2601] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:26.266656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:26.278381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdcfda-7555-46a3-b487-efa84cf48100 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.283314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07629994-f109-41f4-8474-ef8478dfbadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.283922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629994-f109-41f4-8474-ef8478dfbadd admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.284197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629994-f109-41f4-8474-ef8478dfbadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.284489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07629994-f109-41f4-8474-ef8478dfbadd admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.285127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07629994-f109-41f4-8474-ef8478dfbadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.286724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07629994-f109-41f4-8474-ef8478dfbadd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.301828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1299/2602] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:26.302971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:26.314435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a164314-d1cb-4b61-9f00-a0d85ed53efb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.319278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.319940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.320233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.320894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] PATH_INFO: `/v3/projects/3bb70f37f68840a3ae5466f8eb469d13/users/fad24780b4e8458cab1e8075516b77f5/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.336867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb70f37f68840a3ae5466f8eb469d13, user_id=fad24780b4e8458cab1e8075516b77f5, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.339837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.354440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1304/2603] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:26 2022] PUT /identity/v3/projects/3bb70f37f68840a3ae5466f8eb469d13/users/fad24780b4e8458cab1e8075516b77f5/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:26.365068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.365350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.365733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.396899 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] MFA Rules not processed for user `fad24780b4e8458cab1e8075516b77f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:26.398198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:26.465194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1300/2604] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:26.476864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:26.478831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:26.537756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850fd33-125f-441e-bfa8-aa6fa440fdff admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:26.541542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe463bb-b9f5-4de7-a25d-ec8dd6ac5155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:26.542139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe463bb-b9f5-4de7-a25d-ec8dd6ac5155 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:26.542401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe463bb-b9f5-4de7-a25d-ec8dd6ac5155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:26.542668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe463bb-b9f5-4de7-a25d-ec8dd6ac5155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:26.551185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe463bb-b9f5-4de7-a25d-ec8dd6ac5155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:26.552644 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe463bb-b9f5-4de7-a25d-ec8dd6ac5155 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:26.561943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1305/2605] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:29.650485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:29.715755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7426e-691b-434b-b40f-8a12c72a0650 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:29.720917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:29.721567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:29.721835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:29.722096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] PATH_INFO: `/v3/users/fad24780b4e8458cab1e8075516b77f5` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:29.723248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad24780b4e8458cab1e8075516b77f5)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:29.725198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:29.726726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:29.779066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad24780b4e8458cab1e8075516b77f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:29.787079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad24780b4e8458cab1e8075516b77f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:29.787744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad24780b4e8458cab1e8075516b77f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:29.799848 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad24780b4e8458cab1e8075516b77f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:29.800513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad24780b4e8458cab1e8075516b77f5'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:29.813271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1301/2606] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:29 2022] DELETE /identity/v3/users/fad24780b4e8458cab1e8075516b77f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:29.817871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:29.818359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:29.818473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:29.843248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:29.844471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:29.863336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:29.905849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1306/2607] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:29.916440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:29.918064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:29.978496 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501fcfd-2773-400e-a413-be299e82b2a4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:29.982484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124124c0-d29e-439a-821c-232d94ba1ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:29.983078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124124c0-d29e-439a-821c-232d94ba1ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:29.983348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124124c0-d29e-439a-821c-232d94ba1ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:29.983612 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124124c0-d29e-439a-821c-232d94ba1ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:29.992648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124124c0-d29e-439a-821c-232d94ba1ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:29.994510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124124c0-d29e-439a-821c-232d94ba1ca5 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.003648 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1302/2608] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:30.278470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.279938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:30.291918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f0097-923a-4213-ab00-d09f7d146226 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.297344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.298018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.298428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.298698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] PATH_INFO: `/v3/projects/3bb70f37f68840a3ae5466f8eb469d13` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.299824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb70f37f68840a3ae5466f8eb469d13)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.301834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.354090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb70f37f68840a3ae5466f8eb469d13', 'request_id': 'req-0b34e6e2-79de-4b06-a769-690436e4e56e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:30.360091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb70f37f68840a3ae5466f8eb469d13', 'request_id': 'req-0b34e6e2-79de-4b06-a769-690436e4e56e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:30.366398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb70f37f68840a3ae5466f8eb469d13', 'request_id': 'req-0b34e6e2-79de-4b06-a769-690436e4e56e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:30.381779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] The token cache is being invalidate because project 3bb70f37f68840a3ae5466f8eb469d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:30.382069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:30.382766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-0b34e6e2-79de-4b06-a769-690436e4e56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:30.384492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1307/2609] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:30 2022] DELETE /identity/v3/projects/3bb70f37f68840a3ae5466f8eb469d13 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:30.389392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.389676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.389939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.409647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:30.410921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:30.476926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1303/2610] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:30.485631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.485914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.486182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.506786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:30.507984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:30.516032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1308/2611] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:30.520480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.530365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb96daa-7a67-417e-9de2-4d0a76d71cd2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.536259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.536909 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.537182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.537502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.538150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:30.538448 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.540404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.552652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1304/2612] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:33:30.557301 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.566808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfd84f-b2bb-41fa-a05c-619ad9a78d27 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.571758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.572511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.572787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.573055 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.573683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.575565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.605124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1309/2613] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:30 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:30.609547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.620543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1309b3-2fbc-4135-8bda-cd15e3fc10c9 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.625805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:30.681965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.682574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.682852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.683143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.683766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.685729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.710338 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1305/2614] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:30 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:30.715233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.725646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938cfa4-b6b3-4212-a311-f343e5e45ebe admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.731503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.732118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.732414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.732684 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.733337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.734920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.749486 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1310/2615] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:30.750719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.761449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de910a6-b4a1-41e4-a435-91e63c572301 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.766819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8137fe-48d8-47e3-8eed-a07659babe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.767530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8137fe-48d8-47e3-8eed-a07659babe1f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.767809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8137fe-48d8-47e3-8eed-a07659babe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.768334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8137fe-48d8-47e3-8eed-a07659babe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.769107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8137fe-48d8-47e3-8eed-a07659babe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.770835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8137fe-48d8-47e3-8eed-a07659babe1f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.782960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1306/2616] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:30.787366 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:30.797694 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a14e8-f406-4363-aef5-9bc9d7f5bb42 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:30.802579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:30.803223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.803495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.803759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] PATH_INFO: `/v3/projects/e87413d0f94f47c299573c75a5144fa3/users/34c60c29b4a2477fbe4d85bad7e5b714/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.819135 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87413d0f94f47c299573c75a5144fa3, user_id=34c60c29b4a2477fbe4d85bad7e5b714, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:30.822932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:30.840557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1311/2617] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:30 2022] PUT /identity/v3/projects/e87413d0f94f47c299573c75a5144fa3/users/34c60c29b4a2477fbe4d85bad7e5b714/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:30.850328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:30.850608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:30.850881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:30.878939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] MFA Rules not processed for user `34c60c29b4a2477fbe4d85bad7e5b714`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:30.880073 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:30.951732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1307/2618] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:33:30.956515 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.006689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:31.027125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5166fe3-a71a-496c-84e1-c4705fda16d6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.031895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.032537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.032812 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.033081 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.033713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.035621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.066697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1312/2619] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:30 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:31.070893 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.088154 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab6aa2-27f9-4759-a17e-653345446a8b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.139576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.140132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.140423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.140688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.141307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.143264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.165175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1308/2620] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:31 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:31.169302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.180361 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec7b14-c409-4b77-b3c6-adef61edd767 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.186190 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.186796 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.187071 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.187335 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.188000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.189643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.202086 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1313/2621] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:31.206452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.217250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f2633-08e9-42e9-94a3-ae1c8759c589 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.222390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274bf0c-a432-4cca-a114-8ec5b9a3c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.223014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274bf0c-a432-4cca-a114-8ec5b9a3c6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.223320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274bf0c-a432-4cca-a114-8ec5b9a3c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.223581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274bf0c-a432-4cca-a114-8ec5b9a3c6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.224220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274bf0c-a432-4cca-a114-8ec5b9a3c6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.225833 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274bf0c-a432-4cca-a114-8ec5b9a3c6f7 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.227168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:31.241562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1309/2622] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:33:31.246023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.256604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63036ea-ffa4-4140-b44e-44ce97a5fd4f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.262235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.262890 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.263160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.263422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] PATH_INFO: `/v3/projects/3b7bed0cccdf4898a11031736dbbe645/users/cee4542f859540379ec5cfbaa1dbc45b/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.278267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7bed0cccdf4898a11031736dbbe645, user_id=cee4542f859540379ec5cfbaa1dbc45b, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.280982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.306593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1314/2623] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:31 2022] PUT /identity/v3/projects/3b7bed0cccdf4898a11031736dbbe645/users/cee4542f859540379ec5cfbaa1dbc45b/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:31.316708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.316986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.317251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.479407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] MFA Rules not processed for user `cee4542f859540379ec5cfbaa1dbc45b`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:31.480668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:31.546030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1310/2624] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:31.551984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.615810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de35d3c-e6ad-406b-9e30-700aa7584825 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.621185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.621783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.622056 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.622318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.623019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.624933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.655539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1315/2625] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:31 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:31.659441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.670942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936f74-5f91-41d5-8b9f-b4aca9fc88a9 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.729200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.729887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.730054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.730313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.730949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.732861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.759786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1311/2626] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:31 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:31.761048 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.772650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2e815-39dd-491b-a0c0-ba5ad349b303 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.778322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.779030 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.779304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.779587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.780234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.781909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.793897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1316/2627] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:31.798484 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.810045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ee664-abec-4f25-a0f2-7b295d5553ad admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.815970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.816691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.816961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.817237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] PATH_INFO: `/v3/projects/9937731e495d410ebfa8e68757943924/users/63c7ef9dc35f4630b58045b7024310c0/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.832876 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9937731e495d410ebfa8e68757943924, user_id=63c7ef9dc35f4630b58045b7024310c0, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.835464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.850046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1312/2628] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:31 2022] PUT /identity/v3/projects/9937731e495d410ebfa8e68757943924/users/63c7ef9dc35f4630b58045b7024310c0/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:31.854313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.864776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5991cc-4bd8-4c58-9873-36b1d1eb4903 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.927654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c873ebb-7441-4c14-aea1-440f1163fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.928258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c873ebb-7441-4c14-aea1-440f1163fe4c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.928563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c873ebb-7441-4c14-aea1-440f1163fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.928828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c873ebb-7441-4c14-aea1-440f1163fe4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.929459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c873ebb-7441-4c14-aea1-440f1163fe4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.931340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c873ebb-7441-4c14-aea1-440f1163fe4c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.941932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1317/2629] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:31.946286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:31.957135 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e713eb5-d2d8-45af-9000-19322c79a6c8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:31.962263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:31.963319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.963654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.963927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] PATH_INFO: `/v3/projects/9937731e495d410ebfa8e68757943924/users/63c7ef9dc35f4630b58045b7024310c0/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:31.965933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9937731e495d410ebfa8e68757943924, user_id=63c7ef9dc35f4630b58045b7024310c0, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:31.968603 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:31.979891 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1313/2630] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:31 2022] PUT /identity/v3/projects/9937731e495d410ebfa8e68757943924/users/63c7ef9dc35f4630b58045b7024310c0/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:31.990651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:31.991075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:31.991311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:32.000064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:32.021249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] MFA Rules not processed for user `63c7ef9dc35f4630b58045b7024310c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:32.022479 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:32.099824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1318/2631] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:32.111986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:32.113849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:32.159330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:32.176087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2fb66-950d-4dbf-99a5-878f77691262 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:32.179864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:32.180866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:32.181637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:32.181637 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:32.241883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:32.243162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:32.253520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1314/2632] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:33.813632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:33.815158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:33.827828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc82ad5-58da-417d-b6cb-b3406bfc6a16 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:33.831674 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:33.832272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:33.832601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:33.832870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:33.891365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:33.892842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:33.903415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1319/2633] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:34.478545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:34.487618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5ffab-1764-43f2-ac9e-a4e92ec7fead service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:34.491978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f8edf-8f0f-45bd-a221-cfe5889fb6e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:34.492632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f8edf-8f0f-45bd-a221-cfe5889fb6e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:34.492902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f8edf-8f0f-45bd-a221-cfe5889fb6e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:34.493164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f8edf-8f0f-45bd-a221-cfe5889fb6e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:34.502984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f8edf-8f0f-45bd-a221-cfe5889fb6e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:34.504472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f8edf-8f0f-45bd-a221-cfe5889fb6e8 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:34.513994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1315/2634] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:35.897305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:35.898887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:35.971423 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262bef5-645f-4c51-8120-6fb1fa28e94d service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:35.975945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:35.976603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:35.976877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:35.977145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] PATH_INFO: `/v3/users/b7671595f2ad44bd9fda400a96bc3605` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:35.978278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7671595f2ad44bd9fda400a96bc3605)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:35.980243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:36.016445 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:36.030075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7671595f2ad44bd9fda400a96bc3605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.039296 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7671595f2ad44bd9fda400a96bc3605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.046286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7671595f2ad44bd9fda400a96bc3605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.046931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7671595f2ad44bd9fda400a96bc3605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.059153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7671595f2ad44bd9fda400a96bc3605'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.065533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1320/2635] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:35 2022] DELETE /identity/v3/users/b7671595f2ad44bd9fda400a96bc3605 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:36.070696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.071475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.071475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.092903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:36.094110 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:36.156894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1316/2636] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:36.167022 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:36.168570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:36.225690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe225c-e9e1-4589-a020-c3f365a70c1a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:36.229472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d15ae5-34e5-4b35-adfe-4f84f5d7050a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:36.230069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d15ae5-34e5-4b35-adfe-4f84f5d7050a service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.230331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d15ae5-34e5-4b35-adfe-4f84f5d7050a service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.230641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d15ae5-34e5-4b35-adfe-4f84f5d7050a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.239769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d15ae5-34e5-4b35-adfe-4f84f5d7050a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:36.241221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d15ae5-34e5-4b35-adfe-4f84f5d7050a service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:36.251170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1321/2637] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:36.546728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:36.548220 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:36.560644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e95f57-054e-463c-b62e-0db1f30e25f4 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:36.566052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:36.566691 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.566997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.567249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] PATH_INFO: `/v3/projects/563a3d0d05924f9baf6d429f6d4f4b83` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.568547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=563a3d0d05924f9baf6d429f6d4f4b83)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:36.570343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:36.619862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563a3d0d05924f9baf6d429f6d4f4b83', 'request_id': 'req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.625306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563a3d0d05924f9baf6d429f6d4f4b83', 'request_id': 'req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.631461 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563a3d0d05924f9baf6d429f6d4f4b83', 'request_id': 'req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.647401 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] The token cache is being invalidate because project 563a3d0d05924f9baf6d429f6d4f4b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:36.647687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.648314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-62eac88e-f7d8-4c41-a2f5-0498de66cdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:36.649844 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1317/2638] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:36 2022] DELETE /identity/v3/projects/563a3d0d05924f9baf6d429f6d4f4b83 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:36.654776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.655058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.655328 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.674976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:36.676177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:36.737605 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1322/2639] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:36.747054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.747314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.747577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.756469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:36.772494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:36.773853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:36.782780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1318/2640] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:36.788564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:36.798738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cecaa9-efe8-4d19-a5e3-0875e93d0f06 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:36.803473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:36.804075 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.804352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.804654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.805288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:36.805591 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:36.807259 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:36.819473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1323/2641] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 12:33:36.824139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:36.833536 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9105ae-d538-4ef6-be48-26f7ec9bbd09 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:36.839659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:36.840311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.840644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.840935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.841560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:36.843479 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:36.875163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1319/2642] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:36 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:33:36.879093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:36.891434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713adb0-ca64-4665-a7ef-a78f760accfa admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:36.925714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:36.953710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:36.954317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:36.954588 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:36.954864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:36.955459 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:36.957396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:36.981197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1324/2643] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:36 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:33:36.985323 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:36.996506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae5b28-abae-419c-a73b-45d18bcb40dc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:37.001988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:37.002609 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:37.002877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:37.003133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:37.003765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:37.005368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:37.018616 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1320/2644] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:37.020096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:37.031408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086f724-6e33-4cb4-95db-b290b5cd418b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:37.040975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3db3e-b24b-4573-92e4-5f21b6ac7f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:37.041610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3db3e-b24b-4573-92e4-5f21b6ac7f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:37.041872 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3db3e-b24b-4573-92e4-5f21b6ac7f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:37.042161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3db3e-b24b-4573-92e4-5f21b6ac7f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:37.042807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3db3e-b24b-4573-92e4-5f21b6ac7f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:37.044455 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3db3e-b24b-4573-92e4-5f21b6ac7f99 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:37.055319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1325/2645] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:37.059769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:37.070402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23772ffa-778e-4051-8880-191544cf29fb admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:37.075131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:37.075782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:37.076049 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:37.076307 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] PATH_INFO: `/v3/projects/e57ead005fcd46e4a751225d11d4f9e1/users/1c6c4f7d2e6e42b38368cf3eaffc6187/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:37.097008 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57ead005fcd46e4a751225d11d4f9e1, user_id=1c6c4f7d2e6e42b38368cf3eaffc6187, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:37.099865 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:37.115473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1321/2646] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:37 2022] PUT /identity/v3/projects/e57ead005fcd46e4a751225d11d4f9e1/users/1c6c4f7d2e6e42b38368cf3eaffc6187/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:37.121650 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244204-1741-40fe-bd92-444cf8bbcc16 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:37.122009 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244204-1741-40fe-bd92-444cf8bbcc16 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:37.122307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244204-1741-40fe-bd92-444cf8bbcc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:37.146862 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fd244204-1741-40fe-bd92-444cf8bbcc16 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:37.148072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fd244204-1741-40fe-bd92-444cf8bbcc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:37.213085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1326/2647] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:37.223046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:37.224978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:37.284130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20e36e-0a06-4707-87ac-2627a6677799 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:37.288308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:37.288979 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:37.289253 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:37.289544 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:37.299391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:37.300839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:37.310664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1322/2648] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:37.972761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:37.973310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:37.973424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:38.003166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] MFA Rules not processed for user `1c6c4f7d2e6e42b38368cf3eaffc6187`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:38.004518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:38.076661 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1327/2649] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:38.087570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:38.089286 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:38.149780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f3d9-27f1-488a-9aaa-25dbe04ea823 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:38.153377 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b80a62-83a0-4824-a477-1e7df02f413f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:38.153980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80a62-83a0-4824-a477-1e7df02f413f service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:38.154248 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80a62-83a0-4824-a477-1e7df02f413f service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:38.154511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b80a62-83a0-4824-a477-1e7df02f413f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:38.163044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b80a62-83a0-4824-a477-1e7df02f413f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:38.164494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b80a62-83a0-4824-a477-1e7df02f413f service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:38.173247 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1323/2650] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:38.425003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:38.426563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:38.441747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc51b9d8-8027-4da3-958d-d521de71b45d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:38.446944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:38.447789 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:38.448060 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:38.448633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] PATH_INFO: `/v3/users/34c60c29b4a2477fbe4d85bad7e5b714` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:38.450316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c60c29b4a2477fbe4d85bad7e5b714)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:38.452249 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:38.500968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:38.508068 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c60c29b4a2477fbe4d85bad7e5b714'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:38.518489 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c60c29b4a2477fbe4d85bad7e5b714'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:38.525994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c60c29b4a2477fbe4d85bad7e5b714'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:38.526787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c60c29b4a2477fbe4d85bad7e5b714'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:38.539604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c60c29b4a2477fbe4d85bad7e5b714'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:38.546270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1328/2651] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:38 2022] DELETE /identity/v3/users/34c60c29b4a2477fbe4d85bad7e5b714 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:38.550857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:38.551138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:38.551431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:38.571027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:38.572203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:38.614666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:38.635596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1324/2652] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:38.646083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:38.647597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:38.705756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acd140-9f0a-47d2-81ba-79284257c722 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:38.709786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:38.710392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:38.710664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:38.710934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:38.720655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:38.722095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:38.731854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1329/2653] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:39.027436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:39.029054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:39.041977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee25f0b-5fc8-45bc-a9f4-3523280fd0f1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:39.047246 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:39.047870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:39.048137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:39.048461 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] PATH_INFO: `/v3/projects/e87413d0f94f47c299573c75a5144fa3` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:39.049625 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87413d0f94f47c299573c75a5144fa3)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:39.051533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:39.103734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87413d0f94f47c299573c75a5144fa3', 'request_id': 'req-f43909e1-98e3-4517-a05f-2e2b600cb2c8'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.109574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87413d0f94f47c299573c75a5144fa3', 'request_id': 'req-f43909e1-98e3-4517-a05f-2e2b600cb2c8'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.115706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87413d0f94f47c299573c75a5144fa3', 'request_id': 'req-f43909e1-98e3-4517-a05f-2e2b600cb2c8'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.130829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] The token cache is being invalidate because project e87413d0f94f47c299573c75a5144fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:39.131050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.131674 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-f43909e1-98e3-4517-a05f-2e2b600cb2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.133287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1325/2654] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:39 2022] DELETE /identity/v3/projects/e87413d0f94f47c299573c75a5144fa3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:39.137560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:39.147616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fedb6-1e44-4f22-8519-3550ec7ca84c service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:39.205692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:39.206317 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:39.206622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:39.206887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] PATH_INFO: `/v3/users/cee4542f859540379ec5cfbaa1dbc45b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:39.208052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee4542f859540379ec5cfbaa1dbc45b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:39.210067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:39.267635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee4542f859540379ec5cfbaa1dbc45b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.279896 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee4542f859540379ec5cfbaa1dbc45b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.287155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee4542f859540379ec5cfbaa1dbc45b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.287784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee4542f859540379ec5cfbaa1dbc45b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.288917 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:39.301496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee4542f859540379ec5cfbaa1dbc45b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.307239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1330/2655] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:39 2022] DELETE /identity/v3/users/cee4542f859540379ec5cfbaa1dbc45b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:39.560940 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:39.561353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:39.561647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:39.583130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:39.584701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:39.586057 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] MFA Rules not processed for user `1c6c4f7d2e6e42b38368cf3eaffc6187`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:39.587198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:39.646605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1326/2656] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:39.660955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcfa68-fc2a-4e57-bd40-e7a845be0df6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:39.665520 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:39.666340 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:39.666521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:39.666791 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] PATH_INFO: `/v3/projects/3b7bed0cccdf4898a11031736dbbe645` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:39.669495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7bed0cccdf4898a11031736dbbe645)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:39.671440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:39.726580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7bed0cccdf4898a11031736dbbe645', 'request_id': 'req-2388cb4c-526f-47e5-844e-2c967b534439'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.733203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7bed0cccdf4898a11031736dbbe645', 'request_id': 'req-2388cb4c-526f-47e5-844e-2c967b534439'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.739602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7bed0cccdf4898a11031736dbbe645', 'request_id': 'req-2388cb4c-526f-47e5-844e-2c967b534439'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.754223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] The token cache is being invalidate because project 3b7bed0cccdf4898a11031736dbbe645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:39.754511 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.755172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.756742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1331/2657] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:39 2022] DELETE /identity/v3/projects/3b7bed0cccdf4898a11031736dbbe645 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:33:39.760962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:39.772610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475101d7-7fa0-4d57-8908-9450562caddc None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:39.831825 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:39.832489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:39.832750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:39.833007 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] PATH_INFO: `/v3/users/63c7ef9dc35f4630b58045b7024310c0` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:39.835176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c7ef9dc35f4630b58045b7024310c0)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:39.837176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:39.856570 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:39.894079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:39.895677 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:39.899621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c7ef9dc35f4630b58045b7024310c0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.909944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c7ef9dc35f4630b58045b7024310c0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.910970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c7ef9dc35f4630b58045b7024310c0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.924427 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c7ef9dc35f4630b58045b7024310c0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.925335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c7ef9dc35f4630b58045b7024310c0'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:39.938336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1327/2658] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:33:39 2022] DELETE /identity/v3/users/63c7ef9dc35f4630b58045b7024310c0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:39.955635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cb4c-526f-47e5-844e-2c967b534439 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:39.979939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:40.009853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.010501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.010774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.011040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.013088 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:40.023188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.024631 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f3473-2935-4abe-a057-b625dc4f8ff0 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.033182 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1332/2659] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:33:40.277982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.279442 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:40.346184 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2815e6-7c23-4dc6-8c0e-577fb265c730 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.350981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.351640 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.351917 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.352183 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] PATH_INFO: `/v3/projects/9937731e495d410ebfa8e68757943924` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.353318 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9937731e495d410ebfa8e68757943924)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.355314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.416200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9937731e495d410ebfa8e68757943924', 'request_id': 'req-577ba1f7-49ae-44b6-8de1-b9c125383d4b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:40.422567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9937731e495d410ebfa8e68757943924', 'request_id': 'req-577ba1f7-49ae-44b6-8de1-b9c125383d4b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:40.428802 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9937731e495d410ebfa8e68757943924', 'request_id': 'req-577ba1f7-49ae-44b6-8de1-b9c125383d4b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:40.446805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] The token cache is being invalidate because project 9937731e495d410ebfa8e68757943924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:33:40.447393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:40.448215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-577ba1f7-49ae-44b6-8de1-b9c125383d4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:33:40.450146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1328/2660] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:33:40 2022] DELETE /identity/v3/projects/9937731e495d410ebfa8e68757943924 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:40.455040 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.455507 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.455632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.476460 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:40.477728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:40.552869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1333/2661] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:40.560950 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.561227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.561492 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.583587 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:40.584862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:40.593688 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1329/2662] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:40.598132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.608482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fbe58-6005-4e5a-b84d-0cd6f4375f74 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.613590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.614527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.614997 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.615307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.616120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:33:40.616626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.618622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.631881 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1334/2663] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:33:40.636858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.646515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d017bf-eb7a-4129-9b83-2175b8152c2d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.651660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.652270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.652580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.652845 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.653475 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.655485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.671776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:40.688346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1330/2664] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:33:40 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:33:40.692741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.703526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d779f-11a4-44bd-8891-13dc6420597f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.765714 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.766322 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.766596 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.767024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.767585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.769501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.792585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1335/2665] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:33:40 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:33:40.796693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.807472 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aadd2-578f-41ca-9906-769f394493d3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.812598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.813204 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.813834 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.814106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.814746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.816327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.827097 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1331/2666] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:40.831579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.842126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571900f-b255-48d9-926b-c75aa0a2510c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.847067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3558-2aa7-4ddd-99b9-50420d936e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.847667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3558-2aa7-4ddd-99b9-50420d936e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.847943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3558-2aa7-4ddd-99b9-50420d936e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.848210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3558-2aa7-4ddd-99b9-50420d936e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.848916 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c3558-2aa7-4ddd-99b9-50420d936e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.850513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c3558-2aa7-4ddd-99b9-50420d936e29 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.861253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1336/2667] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:33:40.865801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:40.877169 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea6432-37e0-47d5-801d-4338035a6aee admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:40.884172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:40.884172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.884172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.884172 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] PATH_INFO: `/v3/projects/f461ddd7986842159c8e8177a7825435/users/e9f9a02ea89f4991a3042c14cf869432/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.899766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f461ddd7986842159c8e8177a7825435, user_id=e9f9a02ea89f4991a3042c14cf869432, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:40.902510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:40.919101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1332/2668] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:33:40 2022] PUT /identity/v3/projects/f461ddd7986842159c8e8177a7825435/users/e9f9a02ea89f4991a3042c14cf869432/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:33:40.926452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc207-f4ee-41b5-b210-e64be96f1170 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:40.926766 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc207-f4ee-41b5-b210-e64be96f1170 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:40.927032 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc207-f4ee-41b5-b210-e64be96f1170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:40.946590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-5d2cc207-f4ee-41b5-b210-e64be96f1170 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:40.947834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5d2cc207-f4ee-41b5-b210-e64be96f1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:40.979248 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:41.009503 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1337/2669] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:41.019517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:41.021359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:41.080916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f62d-ad9c-4de1-915a-5cdebf7e0b58 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:41.084669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:41.085273 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:41.085549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:41.085813 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:41.095931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:41.097412 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:41.107287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1333/2670] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:41.787614 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:41.788242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:41.788421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:41.819017 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] MFA Rules not processed for user `e9f9a02ea89f4991a3042c14cf869432`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:41.820290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:41.909529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1338/2671] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:41.924363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:41.925983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:41.988551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98bf94-d451-4ce0-80ec-4c23e7f88331 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:41.992653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a5e68-d349-4ccf-a0f5-339a72bc8dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:41.993254 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a5e68-d349-4ccf-a0f5-339a72bc8dfa service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:41.993524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a5e68-d349-4ccf-a0f5-339a72bc8dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:41.993787 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a5e68-d349-4ccf-a0f5-339a72bc8dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:42.002436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a5e68-d349-4ccf-a0f5-339a72bc8dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:42.003852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a5e68-d349-4ccf-a0f5-339a72bc8dfa service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:42.012666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1334/2672] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:43.048407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:43.050656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:43.139023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37215481-087a-4a6c-b75d-4e6b96e6de2b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:43.146300 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:43.147066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:43.147338 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:43.147630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:43.149730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:43.164018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:43.165666 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:43.177465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1339/2673] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:33:43.398252 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:43.398786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:43.398786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:43.418583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] MFA Rules not processed for user `e9f9a02ea89f4991a3042c14cf869432`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:33:43.419967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:43.427315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1335/2674] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:33:53.172140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=77 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:53.412769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=2,keystone:SELECT=72 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:33:59.807722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:33:59.817577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669edc0-26bc-4d8b-805b-69ce7ed2e868 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:33:59.827927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:33:59.828889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:33:59.829171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:33:59.829443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:33:59.831664 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:33:59.845659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:33:59.847152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:33:59.859778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1340/2675] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:03.789395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:03.794270 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:03.816946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287e500-caa6-4d6d-83e8-58c7013b0998 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:03.832862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:03.833826 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:03.834131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:03.834396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] PATH_INFO: `/v3/users/b6717f94a3844d1b82817e0f4adcebad` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:03.835702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6717f94a3844d1b82817e0f4adcebad)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:03.837642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:03.892398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6717f94a3844d1b82817e0f4adcebad'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:03.901778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6717f94a3844d1b82817e0f4adcebad'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:03.902400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6717f94a3844d1b82817e0f4adcebad'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:03.914720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6717f94a3844d1b82817e0f4adcebad'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:03.915308 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-70ddd415-78c1-45f2-8558-1287c85b3543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6717f94a3844d1b82817e0f4adcebad'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:03.927654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1336/2676] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:03 2022] DELETE /identity/v3/users/b6717f94a3844d1b82817e0f4adcebad => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:04.120210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.131192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701f8e3-2614-45ac-8cca-69e4cfa442c7 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.200298 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.200993 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.201268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.201539 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] PATH_INFO: `/v3/projects/12ee39a09d0b4e67898ac55e4fc8aaee` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.202836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ee39a09d0b4e67898ac55e4fc8aaee)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.204830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.265028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ee39a09d0b4e67898ac55e4fc8aaee', 'request_id': 'req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:04.281715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2711b0-180a-45b6-adfa-7e114cfb4bfe None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.282024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2711b0-180a-45b6-adfa-7e114cfb4bfe None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.282290 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2711b0-180a-45b6-adfa-7e114cfb4bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.289943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ee39a09d0b4e67898ac55e4fc8aaee', 'request_id': 'req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:04.297508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ee39a09d0b4e67898ac55e4fc8aaee', 'request_id': 'req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:04.314087 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-3e2711b0-180a-45b6-adfa-7e114cfb4bfe None None] MFA Rules not processed for user `e9f9a02ea89f4991a3042c14cf869432`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:04.314368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] The token cache is being invalidate because project 12ee39a09d0b4e67898ac55e4fc8aaee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:04.314655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:04.315371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-f93970cd-7f6a-46a3-8cfa-a02b3d1c74fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:04.315525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3e2711b0-180a-45b6-adfa-7e114cfb4bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:04.317198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1341/2677] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:04 2022] DELETE /identity/v3/projects/12ee39a09d0b4e67898ac55e4fc8aaee => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:04.323604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.323936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.324210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.352242 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:04.353702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:04.390426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1337/2678] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:04.421955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1342/2679] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:04.430874 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.431165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.431414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.455430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:04.456677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:04.466563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1338/2680] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:04.470849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.480944 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d26c25-de36-48bf-95cd-befe5940114d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.490189 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.490803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.491085 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.491447 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.492101 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:04.492419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.494023 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.509255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1343/2681] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:04.513794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.523459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c12559-f935-4023-aa07-5126eae7d189 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.528052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.528692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.528960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.529219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.529838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.531723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.562499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1339/2682] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:04 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:04.566856 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.573667 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:04.577876 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c261cf-32d1-4d0a-ab7a-b33fe2cf3a05 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.648651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.649281 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.649622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.649839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.650632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.652723 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.676039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1344/2683] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:04 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:04.680315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.691266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37b5d-fd0d-4568-8eaf-e808ca60254a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.696560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.697171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.697440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.697726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.698365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.699960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.712423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1340/2684] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:04.715415 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.726408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3071b-044a-496b-8462-5d7ee653740d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.731279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0b54c-b39d-4994-8cca-4e69c7a3cc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.731889 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b54c-b39d-4994-8cca-4e69c7a3cc5e admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.732162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b54c-b39d-4994-8cca-4e69c7a3cc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.732467 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0b54c-b39d-4994-8cca-4e69c7a3cc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.733104 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0b54c-b39d-4994-8cca-4e69c7a3cc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.734724 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0b54c-b39d-4994-8cca-4e69c7a3cc5e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.747673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1345/2685] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:04.753316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.764068 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cb42f-cedb-4c28-904f-c1cae56e6143 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:04.772355 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:04.773148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.773423 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.773675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] PATH_INFO: `/v3/projects/d55cfcb5accd450b8ababe8eb6a1a4f9/users/2fb8be563bd540de9346b7295090ea1b/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.793571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55cfcb5accd450b8ababe8eb6a1a4f9, user_id=2fb8be563bd540de9346b7295090ea1b, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:04.796398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:04.812716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1341/2686] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:04 2022] PUT /identity/v3/projects/d55cfcb5accd450b8ababe8eb6a1a4f9/users/2fb8be563bd540de9346b7295090ea1b/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:04.823665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:04.823665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:04.824064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:04.854692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] MFA Rules not processed for user `2fb8be563bd540de9346b7295090ea1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:04.856311 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:04.925544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1346/2687] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:04.936762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:04.938656 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:04.953224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:05.026980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d197a-646b-44ef-af07-934a5340a8d9 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:05.034788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bfd00-bea6-418b-92a4-9dfbc0c35b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:05.035400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bfd00-bea6-418b-92a4-9dfbc0c35b40 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:05.035668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bfd00-bea6-418b-92a4-9dfbc0c35b40 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:05.035994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bfd00-bea6-418b-92a4-9dfbc0c35b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:05.045494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bfd00-bea6-418b-92a4-9dfbc0c35b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:05.047114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571bfd00-bea6-418b-92a4-9dfbc0c35b40 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:05.060101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1342/2688] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:07.905846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:07.982659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ddf86-2b8c-45fd-837d-34e0eb471e0a None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:07.987267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:07.988549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:07.988549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:07.988549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] PATH_INFO: `/v3/users/2fb8be563bd540de9346b7295090ea1b` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:07.989597 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb8be563bd540de9346b7295090ea1b)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:07.992344 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:08.008931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:08.051837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb8be563bd540de9346b7295090ea1b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.064139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb8be563bd540de9346b7295090ea1b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.072097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb8be563bd540de9346b7295090ea1b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.072974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb8be563bd540de9346b7295090ea1b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.087971 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb8be563bd540de9346b7295090ea1b'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.098024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1347/2689] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:07 2022] DELETE /identity/v3/users/2fb8be563bd540de9346b7295090ea1b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:08.100734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:08.101424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:08.101525 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:08.121028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:08.122223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:08.201628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1343/2690] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:08.213545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:08.215839 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:08.290171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2506-d948-44f3-b75e-68acf44b1618 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:08.294717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b88952-a223-406f-b2e0-9746e512d57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:08.295332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88952-a223-406f-b2e0-9746e512d57c service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:08.295612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88952-a223-406f-b2e0-9746e512d57c service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:08.295883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b88952-a223-406f-b2e0-9746e512d57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:08.307615 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88952-a223-406f-b2e0-9746e512d57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:08.309521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b88952-a223-406f-b2e0-9746e512d57c service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:08.324603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1348/2691] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:08.651081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:08.654146 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:08.676964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad32a7b-3805-401a-bab5-a7d3f73ec2a5 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:08.685515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:08.686328 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:08.686706 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:08.687137 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] PATH_INFO: `/v3/projects/d55cfcb5accd450b8ababe8eb6a1a4f9` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:08.688558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55cfcb5accd450b8ababe8eb6a1a4f9)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:08.692304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:08.768720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55cfcb5accd450b8ababe8eb6a1a4f9', 'request_id': 'req-1968e551-de38-4a01-9124-5fafc500128c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.778436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55cfcb5accd450b8ababe8eb6a1a4f9', 'request_id': 'req-1968e551-de38-4a01-9124-5fafc500128c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.787171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55cfcb5accd450b8ababe8eb6a1a4f9', 'request_id': 'req-1968e551-de38-4a01-9124-5fafc500128c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.813788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] The token cache is being invalidate because project d55cfcb5accd450b8ababe8eb6a1a4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:08.814101 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.814768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-1968e551-de38-4a01-9124-5fafc500128c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:08.816322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1344/2692] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:08 2022] DELETE /identity/v3/projects/d55cfcb5accd450b8ababe8eb6a1a4f9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:08.821453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:08.821846 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:08.822205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:08.848536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:08.850095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:08.918205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1349/2693] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:08.926520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:08.926805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:08.927056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:08.956954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:08.958364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:08.969345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1345/2694] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:08.973581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:08.983313 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49ab6f-74f5-46fe-87f3-b507ba8db60c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:08.988126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:08.988775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:08.989049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:08.989316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:08.989964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:08.990550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:08.992735 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.006984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1350/2695] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:09.011381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.021080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b7a7e-01d3-4366-b9fe-1abe7e2d4e11 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.025805 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.026417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.026690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.026949 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.028024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.029506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.047257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:09.067342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1346/2696] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:09 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:09.069370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.079390 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1fdf8-cb56-4d90-9d83-cd023d515b4d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.101849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:09.142312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.142920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.143198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.143469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.144093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.146133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.169786 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1351/2697] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:09 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:09.174024 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.184690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91747a-5b96-4c6f-8967-c662a412da7f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.190445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.191112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.191381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.191643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.192245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.193951 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.205378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1347/2698] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:09.210093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.220541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979371b1-622b-43fa-91a3-bbe0c6a6ae45 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.226412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531913d5-9a60-4d59-975e-f6ebf881ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.227096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531913d5-9a60-4d59-975e-f6ebf881ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.227440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531913d5-9a60-4d59-975e-f6ebf881ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.227894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531913d5-9a60-4d59-975e-f6ebf881ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.228665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531913d5-9a60-4d59-975e-f6ebf881ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.230404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531913d5-9a60-4d59-975e-f6ebf881ecf4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.242149 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1352/2699] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:09.248602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.259828 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfbbdb-e438-494f-bd10-603b60013795 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.265331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.266006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.266334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.266597 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] PATH_INFO: `/v3/projects/3340d8d2a38b4306900d32dcf0d9656e/users/ad50dcf251f94922a573bab00371384a/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.283548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3340d8d2a38b4306900d32dcf0d9656e, user_id=ad50dcf251f94922a573bab00371384a, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.286816 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.301583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1348/2700] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:09 2022] PUT /identity/v3/projects/3340d8d2a38b4306900d32dcf0d9656e/users/ad50dcf251f94922a573bab00371384a/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:09.314239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.314660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.315002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.347033 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] MFA Rules not processed for user `ad50dcf251f94922a573bab00371384a`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:09.348252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:09.428449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1353/2701] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:09.432744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.472083 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.473847 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:09.501417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ff5ff-b3dd-4b68-a757-81ef79fa3dc3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.509368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.510011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.510362 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.510713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.511512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.513585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.542983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921d006-1810-42ed-ab52-26a419905bb2 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.551544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.552210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.552521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.553350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.558783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:09.558934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1349/2702] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:09 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:34:09.559789 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.587077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.588594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.599600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1354/2703] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:34:09.659941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f79a-959c-4591-8bd6-17d1d2a05794 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.665501 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.666500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.666962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.667330 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.668870 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.670923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.696543 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1350/2704] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:09 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:09.700773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.720005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8360d6-e67d-4ae0-a0d0-37d5de6822ad service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.726066 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.726692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.726975 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.727299 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.728419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.730352 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.742417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1355/2705] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:09.747389 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.757961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f045598-1494-4b8b-9cb5-7d65c2e65e94 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.764245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.765000 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.765358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.765481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.765906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] PATH_INFO: `/v3/projects/4b21f9520ed44e109ee8eb38015905b4/users/dd461c4b070d43ffbee49b2103df1723/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.788956 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b21f9520ed44e109ee8eb38015905b4, user_id=dd461c4b070d43ffbee49b2103df1723, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.791900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.798634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:09.810572 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1351/2706] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:09 2022] PUT /identity/v3/projects/4b21f9520ed44e109ee8eb38015905b4/users/dd461c4b070d43ffbee49b2103df1723/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:09.814673 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.825117 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:09.839904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa81301-f20e-41b1-9e93-3d17d6c72ca2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.907608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c96a9-4ce5-4e42-aeb0-62943d548fcc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.914455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.915081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.915360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.915630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.916277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.918139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.919035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.919708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.920045 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.920388 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.922260 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:09.933714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1352/2707] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:34:09.933912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.934188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a18db6-c3e6-4051-a231-c64a55e7b308 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.935056 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:09.942955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1356/2708] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:34:09.946903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1584abe-52ae-4f19-99ed-770a35841689 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:09.951668 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:09.952331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.952647 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.952916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] PATH_INFO: `/v3/projects/4b21f9520ed44e109ee8eb38015905b4/users/dd461c4b070d43ffbee49b2103df1723/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:09.954885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b21f9520ed44e109ee8eb38015905b4, user_id=dd461c4b070d43ffbee49b2103df1723, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:09.957556 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:09.968470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1353/2709] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:09 2022] PUT /identity/v3/projects/4b21f9520ed44e109ee8eb38015905b4/users/dd461c4b070d43ffbee49b2103df1723/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:09.979690 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56384be-4167-451b-9a82-40d363317e88 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:09.980087 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56384be-4167-451b-9a82-40d363317e88 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:09.980493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56384be-4167-451b-9a82-40d363317e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:10.011646 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e56384be-4167-451b-9a82-40d363317e88 None None] MFA Rules not processed for user `dd461c4b070d43ffbee49b2103df1723`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:10.013036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e56384be-4167-451b-9a82-40d363317e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:10.086932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1357/2710] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:10.098626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:10.100652 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:10.165226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0aec2-0e42-43d2-aece-fdbf22807eea admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:10.169793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:10.170567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:10.170945 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:10.171287 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:10.181980 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:10.183435 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:10.194107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1354/2711] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:10.242998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56384be-4167-451b-9a82-40d363317e88 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:10.244580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e56384be-4167-451b-9a82-40d363317e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:10.258177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56384be-4167-451b-9a82-40d363317e88 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:10.262815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:10.263439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:10.263709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:10.263973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:10.316627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:10.352545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:10.353833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:10.363817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1358/2712] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:10.376167 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f54bf-5a7c-452b-a134-7392b3f60b45 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:10.380832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:10.381214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:10.381485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:10.381750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:10.383504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:10.435798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:10.463271 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:10.464731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b32afa-f47a-4b43-86d7-ae889c76e527 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:10.476032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1355/2713] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:34:13.794720 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:13.803761 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=100 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:13.883587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523a99c-d505-4d8d-9ec3-88f92256a1a8 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:13.888453 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:13.888734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:13.889010 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:13.889277 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] PATH_INFO: `/v3/users/ad50dcf251f94922a573bab00371384a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:13.890392 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad50dcf251f94922a573bab00371384a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:13.892325 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:13.943824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad50dcf251f94922a573bab00371384a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:13.955386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad50dcf251f94922a573bab00371384a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:13.963287 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad50dcf251f94922a573bab00371384a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:13.963946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad50dcf251f94922a573bab00371384a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:13.975784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad50dcf251f94922a573bab00371384a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:13.981980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1359/2714] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:13 2022] DELETE /identity/v3/users/ad50dcf251f94922a573bab00371384a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:13.986819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:13.987407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:13.987407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:14.007977 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:14.009275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:14.069869 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1356/2715] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:14.082610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:14.084039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:14.151341 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30bec-3114-420d-a3d2-8f7859ac278c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:14.155488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:14.156124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:14.156407 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:14.156686 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:14.167155 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:14.168628 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:14.178160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1360/2716] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:14.481515 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:14.483122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:14.497741 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32159b52-7dcd-46ba-a13b-8179cf222b1d None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:14.503936 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:14.504638 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:14.504928 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:14.505179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] PATH_INFO: `/v3/projects/3340d8d2a38b4306900d32dcf0d9656e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:14.506369 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3340d8d2a38b4306900d32dcf0d9656e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:14.508877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:14.566901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3340d8d2a38b4306900d32dcf0d9656e', 'request_id': 'req-3b4fc87a-3a37-451e-af72-35245137267c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.574259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3340d8d2a38b4306900d32dcf0d9656e', 'request_id': 'req-3b4fc87a-3a37-451e-af72-35245137267c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.581428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3340d8d2a38b4306900d32dcf0d9656e', 'request_id': 'req-3b4fc87a-3a37-451e-af72-35245137267c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.595530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] The token cache is being invalidate because project 3340d8d2a38b4306900d32dcf0d9656e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:14.595944 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.596721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.601762 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1357/2717] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:14 2022] DELETE /identity/v3/projects/3340d8d2a38b4306900d32dcf0d9656e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:14.603084 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:14.622945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de127e1-3dd9-4c89-bfe6-6f64724d3079 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:14.648506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:14.684952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:14.685602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:14.685878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:14.686150 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] PATH_INFO: `/v3/users/dd461c4b070d43ffbee49b2103df1723` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:14.687291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd461c4b070d43ffbee49b2103df1723)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:14.689404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:14.742170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd461c4b070d43ffbee49b2103df1723'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.753240 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd461c4b070d43ffbee49b2103df1723'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.760935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd461c4b070d43ffbee49b2103df1723'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.761595 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd461c4b070d43ffbee49b2103df1723'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.775564 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-1d410cf5-c9aa-4beb-b691-70560418f6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd461c4b070d43ffbee49b2103df1723'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:14.783121 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1361/2718] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:14 2022] DELETE /identity/v3/users/dd461c4b070d43ffbee49b2103df1723 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:15.113798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.115627 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:15.130011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fc87a-3a37-451e-af72-35245137267c admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.188398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.189046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.189317 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.189577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] PATH_INFO: `/v3/projects/4b21f9520ed44e109ee8eb38015905b4` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.190716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b21f9520ed44e109ee8eb38015905b4)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.192636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.194118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:15.243196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b21f9520ed44e109ee8eb38015905b4', 'request_id': 'req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:15.250519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b21f9520ed44e109ee8eb38015905b4', 'request_id': 'req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:15.257646 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b21f9520ed44e109ee8eb38015905b4', 'request_id': 'req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:15.275541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] The token cache is being invalidate because project 4b21f9520ed44e109ee8eb38015905b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:15.275822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:15.276546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-d99a8306-cc4a-4e9d-b19d-239b6e0cdae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:15.278378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1358/2719] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:15 2022] DELETE /identity/v3/projects/4b21f9520ed44e109ee8eb38015905b4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:15.283779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.284282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.284418 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.307061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:15.308243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:15.377137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1362/2720] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:15.384981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.385258 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.385523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.406880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:15.408148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:15.417382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1359/2721] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:15.421838 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.432246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d070d-b907-4322-9db7-2a678f1d8143 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.436823 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.437499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.437777 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.438069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.438797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:15.439134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.440900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.456255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1363/2722] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:15.461383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.471790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e649c-f1c9-4eb8-a35f-7340d8b6937e None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.476804 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.477410 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.477809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.478078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.478699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.480632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.515023 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1360/2723] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:15 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:34:15.519206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.531036 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92741a-798d-41c6-9800-06c9c6c91a6b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.587342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:15.640026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.640950 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.641245 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.641492 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.642221 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.644041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.680572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1364/2724] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:15 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:15.681963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.696100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86b386-f20a-456a-95fd-f93f8651976b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.702725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.703351 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.703621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.703882 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.704554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.706783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.720471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1361/2725] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:15.725833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.737635 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3959fe7-9976-4824-81a9-941cb497a273 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.743293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de36f-6457-4ca9-9800-ea017767b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.744152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de36f-6457-4ca9-9800-ea017767b098 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.744656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de36f-6457-4ca9-9800-ea017767b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.745122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de36f-6457-4ca9-9800-ea017767b098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.746355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2de36f-6457-4ca9-9800-ea017767b098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.751702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2de36f-6457-4ca9-9800-ea017767b098 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.771028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1365/2726] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:15.775921 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:15.787519 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2da45-7c64-44f6-82b3-c6eded7ebc56 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:15.794301 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:15.795181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.795660 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.796133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] PATH_INFO: `/v3/projects/cce1938abc6148dc9cebc6e6b8682d29/users/9cb8d13410104ecb873fc5a872a17703/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.818164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce1938abc6148dc9cebc6e6b8682d29, user_id=9cb8d13410104ecb873fc5a872a17703, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:15.821020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:15.858846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1362/2727] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:15 2022] PUT /identity/v3/projects/cce1938abc6148dc9cebc6e6b8682d29/users/9cb8d13410104ecb873fc5a872a17703/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:15.861707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:15.861994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:15.862266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:15.911687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] MFA Rules not processed for user `9cb8d13410104ecb873fc5a872a17703`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:15.913186 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:15.998170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1366/2728] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:16.002447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.077325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0589f-2e0e-46a1-9ab9-6c679ecfcf46 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.082506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.083182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.083863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.084045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.084911 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.086803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.130598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1363/2729] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:16 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:34:16.132697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.144193 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029145c-a953-448d-b64e-9a62369e4e37 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.204858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.205469 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.205740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.206000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.206619 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.208575 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.234726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1367/2730] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:16 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:16.238992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.250230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eeb267-4897-4149-af04-941e3461f51f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.254729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.255334 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.255661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.255854 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.256703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.258388 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.263922 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:16.270315 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1364/2731] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:16.274636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.285758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60e47a-bc92-4ccb-a048-e90f297d809b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.291126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.291787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.292062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.292332 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] PATH_INFO: `/v3/projects/b7276056ba6143458ae10746530194ab/users/a84c0251d5064b9ba3a19ae8a0dce15e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.307379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7276056ba6143458ae10746530194ab, user_id=a84c0251d5064b9ba3a19ae8a0dce15e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.310067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.327439 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1368/2732] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:16 2022] PUT /identity/v3/projects/b7276056ba6143458ae10746530194ab/users/a84c0251d5064b9ba3a19ae8a0dce15e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:16.331695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.342596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423b439-74c4-4e9f-8482-e32a4beb9930 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.400530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288d131-4f0a-425a-bd4a-dbd8399442d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.401126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d131-4f0a-425a-bd4a-dbd8399442d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.401392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d131-4f0a-425a-bd4a-dbd8399442d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.401659 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288d131-4f0a-425a-bd4a-dbd8399442d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.402295 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288d131-4f0a-425a-bd4a-dbd8399442d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.403877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288d131-4f0a-425a-bd4a-dbd8399442d6 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.414622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1365/2733] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:34:16.419046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.429951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc316e-1878-4977-a329-bd8bd7438af5 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.435168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.435815 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.436091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.436359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] PATH_INFO: `/v3/projects/b7276056ba6143458ae10746530194ab/users/a84c0251d5064b9ba3a19ae8a0dce15e/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.438319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7276056ba6143458ae10746530194ab, user_id=a84c0251d5064b9ba3a19ae8a0dce15e, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.441003 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.443191 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:16.452891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1369/2734] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:16 2022] PUT /identity/v3/projects/b7276056ba6143458ae10746530194ab/users/a84c0251d5064b9ba3a19ae8a0dce15e/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:16.463778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.464053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.464316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.492316 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] MFA Rules not processed for user `a84c0251d5064b9ba3a19ae8a0dce15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:16.493548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:16.564111 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1366/2735] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:16.576485 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.578405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:16.642183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d08ec-a46c-4650-92c2-4b6a040264a2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.645858 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05eabe5-6a96-4185-9015-890c7c19e77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.646480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eabe5-6a96-4185-9015-890c7c19e77a service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.646901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eabe5-6a96-4185-9015-890c7c19e77a service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.647213 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05eabe5-6a96-4185-9015-890c7c19e77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.656424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05eabe5-6a96-4185-9015-890c7c19e77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.657831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05eabe5-6a96-4185-9015-890c7c19e77a service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.667408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1370/2736] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:16.695614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.759487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d961e5-47c0-4608-a36e-fa892b3e671b None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:16.764304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:16.764959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.765230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.765487 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] PATH_INFO: `/v3/users/9cb8d13410104ecb873fc5a872a17703` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.766654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb8d13410104ecb873fc5a872a17703)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:16.774596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:16.797725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:16.828066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb8d13410104ecb873fc5a872a17703'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:16.836765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb8d13410104ecb873fc5a872a17703'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:16.837444 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb8d13410104ecb873fc5a872a17703'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:16.850029 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb8d13410104ecb873fc5a872a17703'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:16.851067 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb8d13410104ecb873fc5a872a17703'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:16.865033 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1367/2737] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:16 2022] DELETE /identity/v3/users/9cb8d13410104ecb873fc5a872a17703 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:16.870363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:16.870648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:16.871263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:16.895037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:16.896571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:16.966095 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1371/2738] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:16.975947 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:16.977807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:17.046336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa3be2-b5c9-490d-a062-6031d5c3c01f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:17.049974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:17.050580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:17.050851 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:17.051119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:17.060829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:17.062278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:17.072195 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1368/2739] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:17.370188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:17.372308 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:17.387998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786792c-9080-4203-84f5-70d8fb1c21df None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:17.392957 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:17.393816 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:17.394093 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:17.394358 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] PATH_INFO: `/v3/projects/cce1938abc6148dc9cebc6e6b8682d29` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:17.395484 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce1938abc6148dc9cebc6e6b8682d29)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:17.397865 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:17.449106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce1938abc6148dc9cebc6e6b8682d29', 'request_id': 'req-656e3f9d-6317-478f-a50e-4ee5abba1e66'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.454942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce1938abc6148dc9cebc6e6b8682d29', 'request_id': 'req-656e3f9d-6317-478f-a50e-4ee5abba1e66'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.461794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce1938abc6148dc9cebc6e6b8682d29', 'request_id': 'req-656e3f9d-6317-478f-a50e-4ee5abba1e66'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.483643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] The token cache is being invalidate because project cce1938abc6148dc9cebc6e6b8682d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:17.483914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.484600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.486115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1372/2740] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:17 2022] DELETE /identity/v3/projects/cce1938abc6148dc9cebc6e6b8682d29 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:17.490314 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:17.500645 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e6c6d-390b-4779-9c69-af898aebe4fd service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:17.557400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:17.558017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:17.558288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:17.558555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] PATH_INFO: `/v3/users/a84c0251d5064b9ba3a19ae8a0dce15e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:17.559692 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84c0251d5064b9ba3a19ae8a0dce15e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:17.561632 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:17.609511 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:17.611116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84c0251d5064b9ba3a19ae8a0dce15e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.619858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84c0251d5064b9ba3a19ae8a0dce15e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.620669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84c0251d5064b9ba3a19ae8a0dce15e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.633274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84c0251d5064b9ba3a19ae8a0dce15e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.633897 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-19f5123e-4c05-47cf-bb56-8c9e0cb14f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84c0251d5064b9ba3a19ae8a0dce15e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:17.645969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1369/2741] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:17 2022] DELETE /identity/v3/users/a84c0251d5064b9ba3a19ae8a0dce15e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:17.926736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:17.928252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:17.943194 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e3f9d-6317-478f-a50e-4ee5abba1e66 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:17.961192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:18.005205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.005753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.006028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.006297 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] PATH_INFO: `/v3/projects/b7276056ba6143458ae10746530194ab` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.008043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7276056ba6143458ae10746530194ab)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.009977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.059624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7276056ba6143458ae10746530194ab', 'request_id': 'req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:18.065324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7276056ba6143458ae10746530194ab', 'request_id': 'req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:18.071888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7276056ba6143458ae10746530194ab', 'request_id': 'req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:18.086671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] The token cache is being invalidate because project b7276056ba6143458ae10746530194ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:18.086961 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:18.087601 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d51d6d47-2d3f-4110-9b9d-6af22b3e67ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:18.089162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1373/2742] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:17 2022] DELETE /identity/v3/projects/b7276056ba6143458ae10746530194ab => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:18.094148 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.094434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.094700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.114340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:18.115541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:18.178147 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1370/2743] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:18.185779 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.186080 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.186365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.207555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:18.208814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:18.218965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1374/2744] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:18.223414 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.233941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c378d-7005-43e7-ae98-9065f55a7883 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.239161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.239769 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.240044 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.240309 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.241264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:18.241783 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.242991 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.255725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1371/2745] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:18.260850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.270998 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc18ef-ada9-4225-8bf9-335526781e38 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.276687 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.277293 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.277581 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.277832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.278436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.280336 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.317409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1375/2746] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:34:18.321738 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.333884 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c321748-aa37-414b-b7e7-60c20c50c88f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.394546 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.395165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.395467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.395734 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.396371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.398396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.420400 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1372/2747] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:18.424708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.435867 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b5f46-c47d-4851-a502-5fb2d9f2ba88 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.441228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.441834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.442110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.442376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.443046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.445109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.458440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1376/2748] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:18.459480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.469626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7ff2f-e91b-4486-a3c6-a5aaf9b55adb admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.476699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c67d2d-dbce-4640-9214-a352e3ab0ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.477743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c67d2d-dbce-4640-9214-a352e3ab0ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.478237 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c67d2d-dbce-4640-9214-a352e3ab0ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.479920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c67d2d-dbce-4640-9214-a352e3ab0ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.479920 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c67d2d-dbce-4640-9214-a352e3ab0ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.482120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c67d2d-dbce-4640-9214-a352e3ab0ceb admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.494264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1373/2749] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:18.498506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.509292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13030fd6-3f5e-4337-8370-343842dea48c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.516909 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.517589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.517860 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.518314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] PATH_INFO: `/v3/projects/9827d7c86841481dad8b7d338f40e2ab/users/7dc78064a9434572afcad2a060471df3/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.535822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9827d7c86841481dad8b7d338f40e2ab, user_id=7dc78064a9434572afcad2a060471df3, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.538612 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.561179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1377/2750] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:18 2022] PUT /identity/v3/projects/9827d7c86841481dad8b7d338f40e2ab/users/7dc78064a9434572afcad2a060471df3/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:18.573215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.574006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.574336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.607103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] MFA Rules not processed for user `7dc78064a9434572afcad2a060471df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:18.608327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:18.627528 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:18.689500 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1374/2751] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:18.694759 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.744278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:18.764679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61db52-fc83-413b-bc9d-4da626f04576 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.771405 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.772966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.773257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.773529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.774235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.777031 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.812021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1378/2752] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:18.813161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.824685 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985560d-1412-4821-b789-ebe6597ed579 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.884465 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.885088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.885359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.885620 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.886244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.888165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.914016 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1375/2753] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:18 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:18.918175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.928401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2073d-0e6e-4fee-a63b-5a083d50fc7d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.933134 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.933749 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.934020 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.934282 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.934912 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.936557 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:18.947535 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1379/2754] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:18.951852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:18.962313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224c96a-9e62-459b-ba54-cb46e24bba4b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:18.968300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:18.969003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:18.969275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:18.969540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] PATH_INFO: `/v3/projects/ba625cd622774b62b2872394e93fcd2f/users/0d4628daff9f4086a891620201128fbe/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:18.985698 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba625cd622774b62b2872394e93fcd2f, user_id=0d4628daff9f4086a891620201128fbe, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:18.988357 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:19.004238 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1376/2755] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:18 2022] PUT /identity/v3/projects/ba625cd622774b62b2872394e93fcd2f/users/0d4628daff9f4086a891620201128fbe/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:19.008589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:19.019497 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf21d-10c0-4c9b-98c7-c4bbdbe06533 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:19.080979 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c01115-7f14-4fa0-9d47-97030e193e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:19.083402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c01115-7f14-4fa0-9d47-97030e193e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.083402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c01115-7f14-4fa0-9d47-97030e193e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.083402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c01115-7f14-4fa0-9d47-97030e193e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.083402 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c01115-7f14-4fa0-9d47-97030e193e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:19.084359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c01115-7f14-4fa0-9d47-97030e193e1f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:19.094798 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1380/2756] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:19.099163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:19.109850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cc637-fe1c-43eb-9f2c-2b500a557029 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:19.114689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:19.115340 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.115639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.115953 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] PATH_INFO: `/v3/projects/ba625cd622774b62b2872394e93fcd2f/users/0d4628daff9f4086a891620201128fbe/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.118052 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba625cd622774b62b2872394e93fcd2f, user_id=0d4628daff9f4086a891620201128fbe, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:19.120658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:19.132244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1377/2757] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:19 2022] PUT /identity/v3/projects/ba625cd622774b62b2872394e93fcd2f/users/0d4628daff9f4086a891620201128fbe/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:19.146078 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.146443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.146732 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.179315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] MFA Rules not processed for user `0d4628daff9f4086a891620201128fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:19.180582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:19.251451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1381/2758] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:19.263998 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:19.265822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:19.324518 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976772e2-6f01-46ac-b384-547b0ae1003b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:19.328353 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303761c4-a6ff-4869-9101-d179ef14e81b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:19.328970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303761c4-a6ff-4869-9101-d179ef14e81b service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.329226 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303761c4-a6ff-4869-9101-d179ef14e81b service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.329485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303761c4-a6ff-4869-9101-d179ef14e81b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.339259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303761c4-a6ff-4869-9101-d179ef14e81b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:19.340733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303761c4-a6ff-4869-9101-d179ef14e81b service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:19.350555 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1378/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:19 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:19.417853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:19.464987 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:19.483376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad630f7-8e8b-41ae-907b-1ee7fe7a289b None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:19.487965 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:19.488621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.488895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.489166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] PATH_INFO: `/v3/users/7dc78064a9434572afcad2a060471df3` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.490286 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc78064a9434572afcad2a060471df3)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:19.492235 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:19.540905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc78064a9434572afcad2a060471df3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:19.550899 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc78064a9434572afcad2a060471df3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:19.558921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc78064a9434572afcad2a060471df3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:19.559680 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc78064a9434572afcad2a060471df3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:19.572585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc78064a9434572afcad2a060471df3'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:19.580630 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1382/2760] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:19 2022] DELETE /identity/v3/users/7dc78064a9434572afcad2a060471df3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:19.586926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.587428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.587428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.608445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:19.609695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:19.618877 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:19.670280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1379/2761] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:19.680464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:19.681907 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:19.740185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c546-f1a5-4b2e-81de-bc1332d2b35b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:19.744028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:19.744671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:19.744945 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:19.748064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:19.755324 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:19.757074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:19.767880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1383/2762] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:20.102861 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:20.104590 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:20.117963 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151020-9b51-4b12-861c-ddf5758dabec None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:20.123857 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:20.124524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:20.124710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:20.124975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] PATH_INFO: `/v3/projects/9827d7c86841481dad8b7d338f40e2ab` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:20.126196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9827d7c86841481dad8b7d338f40e2ab)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:20.128337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:20.181460 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9827d7c86841481dad8b7d338f40e2ab', 'request_id': 'req-54cf3bff-cc39-4544-9f05-170c1d1986fa'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.187654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9827d7c86841481dad8b7d338f40e2ab', 'request_id': 'req-54cf3bff-cc39-4544-9f05-170c1d1986fa'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.194474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9827d7c86841481dad8b7d338f40e2ab', 'request_id': 'req-54cf3bff-cc39-4544-9f05-170c1d1986fa'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.210081 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] The token cache is being invalidate because project 9827d7c86841481dad8b7d338f40e2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:20.210425 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.211035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.212752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1380/2763] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:20 2022] DELETE /identity/v3/projects/9827d7c86841481dad8b7d338f40e2ab => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:20.218396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:20.232828 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da460c-61e0-4415-8623-91b79ffc0d46 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:20.295283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:20.295922 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:20.296199 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:20.296509 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] PATH_INFO: `/v3/users/0d4628daff9f4086a891620201128fbe` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:20.297671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4628daff9f4086a891620201128fbe)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:20.299579 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:20.304563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:20.350657 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4628daff9f4086a891620201128fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.359699 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4628daff9f4086a891620201128fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.368062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4628daff9f4086a891620201128fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.368808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4628daff9f4086a891620201128fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.381681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-922d41f5-cdba-4800-96ca-2d87333ed686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4628daff9f4086a891620201128fbe'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.387992 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1384/2764] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:20 2022] DELETE /identity/v3/users/0d4628daff9f4086a891620201128fbe => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:20.690880 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:20.692491 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:20.705526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3bff-cc39-4544-9f05-170c1d1986fa admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:20.762062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:20.762976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:20.762976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:20.763337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] PATH_INFO: `/v3/projects/ba625cd622774b62b2872394e93fcd2f` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:20.764439 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba625cd622774b62b2872394e93fcd2f)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:20.766477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:20.810320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:20.824687 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba625cd622774b62b2872394e93fcd2f', 'request_id': 'req-642430a0-ffa9-4eb3-b837-77c8863257e3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.831970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba625cd622774b62b2872394e93fcd2f', 'request_id': 'req-642430a0-ffa9-4eb3-b837-77c8863257e3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.839006 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba625cd622774b62b2872394e93fcd2f', 'request_id': 'req-642430a0-ffa9-4eb3-b837-77c8863257e3'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.854045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] The token cache is being invalidate because project ba625cd622774b62b2872394e93fcd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:20.854350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.855064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-642430a0-ffa9-4eb3-b837-77c8863257e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:20.856653 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1381/2765] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:20 2022] DELETE /identity/v3/projects/ba625cd622774b62b2872394e93fcd2f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:20.861665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:20.862169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:20.862272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:20.883200 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:20.884345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:20.952365 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1385/2766] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:20.961591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:20.961926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:20.962158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:20.982432 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:20.983642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:20.992094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1382/2767] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:20.997029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.007689 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59affc9c-a472-4891-ab3e-1fe89c2f7da7 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.012214 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.012879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.013140 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.013404 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.014047 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:21.014347 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.015937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.030120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1386/2768] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:21.034686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.046712 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc35fda-7a2d-43f5-a8f5-afb05ef3a311 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.052551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.053194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.053466 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.053730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.055030 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.057106 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.099682 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1383/2769] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:21 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:21.101551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.111895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6580b7-dc6c-4b81-b6f2-a2dd749d3013 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.169316 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.169837 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.170112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.170379 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.170991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.172972 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.192349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:21.198243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1387/2770] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:21 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:21.202600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.213537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ee544-12d9-4232-a17e-a0a50133f929 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.219099 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.219699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.219986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.220243 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.220916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.222520 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.236062 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1384/2771] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:34:21.237359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.248506 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f90be-ea76-4b56-808d-cf5e2927a3f3 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.253377 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10f959-8f80-4047-992b-d30841e57247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.253982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10f959-8f80-4047-992b-d30841e57247 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.254247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10f959-8f80-4047-992b-d30841e57247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.254512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10f959-8f80-4047-992b-d30841e57247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.255143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10f959-8f80-4047-992b-d30841e57247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.256925 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10f959-8f80-4047-992b-d30841e57247 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.268114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1388/2772] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:21.272666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.282530 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d40cc2-0a49-4de2-bd91-b82a3d36175e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.287063 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.287705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.288009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.288289 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] PATH_INFO: `/v3/projects/de1f7640f8454921bb870d8ebff3d769/users/41e5864c209340ed8b899960046ef003/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.304434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1f7640f8454921bb870d8ebff3d769, user_id=41e5864c209340ed8b899960046ef003, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.307112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.325166 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1385/2773] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:21 2022] PUT /identity/v3/projects/de1f7640f8454921bb870d8ebff3d769/users/41e5864c209340ed8b899960046ef003/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:21.394806 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.395094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.395512 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.434895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] MFA Rules not processed for user `41e5864c209340ed8b899960046ef003`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:21.436098 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:21.643880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1389/2774] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:21.648477 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.714387 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f38ec-a78a-4a6f-be40-545849c43b1d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.719782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.720485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.720704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.720968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.721589 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.723524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.760630 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1386/2775] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:21 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:21.764616 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.777145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450bf18-0c4f-4e0f-b615-c99772c6ca03 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.840966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.841554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.841829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.842094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.842708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.844618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.873263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1390/2776] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:21 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:21.877324 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.891968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6a71-0486-43b8-abd0-988f7e9130f8 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.893547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.894157 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.894447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.894694 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.895332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.896969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.908608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1387/2777] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:21.913168 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.923268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b76db-2f8a-4949-89e6-49659e5b0b2d admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:21.927908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:21.928567 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:21.928843 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:21.929111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] PATH_INFO: `/v3/projects/1e03bae121e64902b7fcb24f8876cd2d/users/7c8b0749426c4fdf961bd37ca0b3cae2/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:21.943570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e03bae121e64902b7fcb24f8876cd2d, user_id=7c8b0749426c4fdf961bd37ca0b3cae2, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:21.946421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:21.963970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1391/2778] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:21 2022] PUT /identity/v3/projects/1e03bae121e64902b7fcb24f8876cd2d/users/7c8b0749426c4fdf961bd37ca0b3cae2/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:21.969989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:21.981743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aef052-4eb8-495e-8d2d-72b0ddba21a5 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:22.016600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:22.042786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5889001-adf2-4e03-ba40-952c370526e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:22.043467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5889001-adf2-4e03-ba40-952c370526e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:22.043745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5889001-adf2-4e03-ba40-952c370526e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:22.044060 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5889001-adf2-4e03-ba40-952c370526e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:22.044819 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5889001-adf2-4e03-ba40-952c370526e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:22.046430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5889001-adf2-4e03-ba40-952c370526e2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:22.056664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1388/2779] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:22.061266 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:22.072560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d3c96-e6e6-4608-a830-2c99e83cf61e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:22.077753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:22.081589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:22.081589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:22.081589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] PATH_INFO: `/v3/projects/1e03bae121e64902b7fcb24f8876cd2d/users/7c8b0749426c4fdf961bd37ca0b3cae2/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:22.081589 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e03bae121e64902b7fcb24f8876cd2d, user_id=7c8b0749426c4fdf961bd37ca0b3cae2, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:22.083530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:22.096145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1392/2780] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:22 2022] PUT /identity/v3/projects/1e03bae121e64902b7fcb24f8876cd2d/users/7c8b0749426c4fdf961bd37ca0b3cae2/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:22.107050 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357501b-5cde-4409-a171-930212772c9a None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:22.107335 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357501b-5cde-4409-a171-930212772c9a None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:22.107599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357501b-5cde-4409-a171-930212772c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:22.138404 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e357501b-5cde-4409-a171-930212772c9a None None] MFA Rules not processed for user `7c8b0749426c4fdf961bd37ca0b3cae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:22.139708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e357501b-5cde-4409-a171-930212772c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:22.220300 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1389/2781] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:22.428580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:22.430569 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:22.465902 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:22.492440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa3be9-c7b7-4288-a567-042569c3804a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:22.497102 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df27092-2a83-4c8a-b69b-ee6144016687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:22.497711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27092-2a83-4c8a-b69b-ee6144016687 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:22.498108 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27092-2a83-4c8a-b69b-ee6144016687 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:22.498383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df27092-2a83-4c8a-b69b-ee6144016687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:22.511968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df27092-2a83-4c8a-b69b-ee6144016687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:22.513790 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df27092-2a83-4c8a-b69b-ee6144016687 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:22.524481 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1393/2782] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:22.669200 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357501b-5cde-4409-a171-930212772c9a None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:22.741179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357501b-5cde-4409-a171-930212772c9a None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:22.746232 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:22.746926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:22.747216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:22.747498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] PATH_INFO: `/v3/users/41e5864c209340ed8b899960046ef003` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:22.748703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41e5864c209340ed8b899960046ef003)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:22.750623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:22.798793 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41e5864c209340ed8b899960046ef003'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:22.807577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41e5864c209340ed8b899960046ef003'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:22.808207 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41e5864c209340ed8b899960046ef003'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:22.814109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:22.823863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41e5864c209340ed8b899960046ef003'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:22.825122 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41e5864c209340ed8b899960046ef003'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:22.841014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1390/2783] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:22 2022] DELETE /identity/v3/users/41e5864c209340ed8b899960046ef003 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:22.846369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:22.846713 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:22.847046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:22.867376 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:22.868636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:22.930394 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1394/2784] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:22.942961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:22.944760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:23.003969 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6162dc2-a584-4167-ab0b-a2c744d29209 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:23.010510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:23.011450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:23.011887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:23.012327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:23.027211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:23.029469 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:23.044494 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1391/2785] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:23.332114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:23.333937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:23.357668 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac2d0d-7fd6-4240-88a4-2e23cf79df03 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:23.362462 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:23.363122 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:23.363395 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:23.363663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] PATH_INFO: `/v3/projects/de1f7640f8454921bb870d8ebff3d769` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:23.364835 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1f7640f8454921bb870d8ebff3d769)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:23.367321 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:23.419875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1f7640f8454921bb870d8ebff3d769', 'request_id': 'req-4ea916e7-2a17-4fa3-916f-1b41cb070adc'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.426133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1f7640f8454921bb870d8ebff3d769', 'request_id': 'req-4ea916e7-2a17-4fa3-916f-1b41cb070adc'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.432716 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1f7640f8454921bb870d8ebff3d769', 'request_id': 'req-4ea916e7-2a17-4fa3-916f-1b41cb070adc'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.447655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] The token cache is being invalidate because project de1f7640f8454921bb870d8ebff3d769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:23.447970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.448756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.450363 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1395/2786] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:23 2022] DELETE /identity/v3/projects/de1f7640f8454921bb870d8ebff3d769 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:23.454365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:23.464168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ab147-8511-465a-9ec9-1a990ee1c3a4 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:23.519958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:23.520655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:23.520931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:23.521261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] PATH_INFO: `/v3/users/7c8b0749426c4fdf961bd37ca0b3cae2` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:23.522459 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8b0749426c4fdf961bd37ca0b3cae2)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:23.524777 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:23.576665 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8b0749426c4fdf961bd37ca0b3cae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.586371 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8b0749426c4fdf961bd37ca0b3cae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.587116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8b0749426c4fdf961bd37ca0b3cae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.599305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8b0749426c4fdf961bd37ca0b3cae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.599958 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-2ff0a7f5-3b27-4c7f-8846-e5db6f95d692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8b0749426c4fdf961bd37ca0b3cae2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:23.609182 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:23.613744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1392/2787] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:23 2022] DELETE /identity/v3/users/7c8b0749426c4fdf961bd37ca0b3cae2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:23.907435 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:23.909570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:23.937412 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea916e7-2a17-4fa3-916f-1b41cb070adc admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:23.991537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:24.001236 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.002094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.002350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.002643 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] PATH_INFO: `/v3/projects/1e03bae121e64902b7fcb24f8876cd2d` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.003958 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e03bae121e64902b7fcb24f8876cd2d)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.006145 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.054607 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e03bae121e64902b7fcb24f8876cd2d', 'request_id': 'req-b7e5f8df-a3bd-405d-83bb-a8092ee72653'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:24.060197 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e03bae121e64902b7fcb24f8876cd2d', 'request_id': 'req-b7e5f8df-a3bd-405d-83bb-a8092ee72653'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:24.066318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e03bae121e64902b7fcb24f8876cd2d', 'request_id': 'req-b7e5f8df-a3bd-405d-83bb-a8092ee72653'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:24.080886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] The token cache is being invalidate because project 1e03bae121e64902b7fcb24f8876cd2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:24.081162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:24.081799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-b7e5f8df-a3bd-405d-83bb-a8092ee72653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:24.083307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1396/2788] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:23 2022] DELETE /identity/v3/projects/1e03bae121e64902b7fcb24f8876cd2d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:24.088667 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.089188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.089188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.109311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:24.110481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:24.170675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1393/2789] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:24.179803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.180077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.180360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.201355 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:24.202703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:24.211715 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1397/2790] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:24.216206 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.226809 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0db322-25df-44b2-a307-9ba7b68831af None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.232189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.232811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.233085 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.233349 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.233985 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:24.234280 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.235867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.247759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1394/2791] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:24.252224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.261809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364da21-97bf-4df0-8ba3-f4586d0433af None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.266754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.267343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.267613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.267883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.268542 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.270411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.299604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1398/2792] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:24.303984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.314927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f011-5761-49d7-9e7a-19c5c0d09f93 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.379595 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.380198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.380571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.380858 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.381455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.384066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.409930 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1395/2793] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:24.415693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.426783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063351eb-88b2-4a97-9e00-8561913205b2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.432000 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.432622 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.432904 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.433170 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.433807 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.435390 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.446210 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1399/2794] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:24.450485 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.461170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc3fb2-8b70-4d6d-82e0-a3674a8de674 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.467155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d13eae-96b5-49f3-b2de-ec91d81ae3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.467753 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13eae-96b5-49f3-b2de-ec91d81ae3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.468031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13eae-96b5-49f3-b2de-ec91d81ae3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.468288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d13eae-96b5-49f3-b2de-ec91d81ae3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.468971 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d13eae-96b5-49f3-b2de-ec91d81ae3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.470954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d13eae-96b5-49f3-b2de-ec91d81ae3e8 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.481803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1396/2795] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:24.486280 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.496940 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e4b18-8c38-4dd7-826f-1fc9295df0b8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.502359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.503147 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.503383 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.503702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] PATH_INFO: `/v3/projects/51bd10d4e93645afbe936b2288f5f153/users/685eda43e91641d58689d5577d9711bb/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.525319 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=51bd10d4e93645afbe936b2288f5f153, user_id=685eda43e91641d58689d5577d9711bb, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.527994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.543984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1400/2796] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:24 2022] PUT /identity/v3/projects/51bd10d4e93645afbe936b2288f5f153/users/685eda43e91641d58689d5577d9711bb/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:24.554986 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.555277 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.555560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.586584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] MFA Rules not processed for user `685eda43e91641d58689d5577d9711bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:24.587729 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:24.647312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:24.658064 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1397/2797] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:24.662561 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.739089 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b9a3c-83a7-4113-9459-b29721db6f9a admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.745706 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.746659 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.746918 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.747176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.747800 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.749741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.781096 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1401/2798] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:34:24.785305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.796759 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a16835-f823-4ab0-a83a-56fa39c0c582 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.860462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.860988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.861265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.861531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.862162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.864082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.888823 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1398/2799] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:24 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:24.892931 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.904123 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc45408-a011-401f-845c-786901a2fa52 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.909712 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.910310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.910580 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.910869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.911499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.913129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.915648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:24.925502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1402/2800] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:24.929916 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:24.944631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66fc76-7d4d-461d-84f3-0cb0ceca0a85 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:24.950370 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:24.951031 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:24.951298 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:24.951561 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] PATH_INFO: `/v3/projects/555129ea9a614b7681ea16e3a1e2426c/users/ba3b1e847e604720a35ebdc661eabaa7/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:24.967032 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] RBAC: Authorizing `identity:create_grant(project_id=555129ea9a614b7681ea16e3a1e2426c, user_id=ba3b1e847e604720a35ebdc661eabaa7, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:24.969707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:24.984718 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1399/2801] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:24 2022] PUT /identity/v3/projects/555129ea9a614b7681ea16e3a1e2426c/users/ba3b1e847e604720a35ebdc661eabaa7/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:24.990310 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:25.002824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c4cd-0098-4089-b411-526ec26b3d6b admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:25.064058 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15b123-35e2-4ed9-a9f1-7375c83c7641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:25.064701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b123-35e2-4ed9-a9f1-7375c83c7641 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:25.064981 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b123-35e2-4ed9-a9f1-7375c83c7641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:25.065251 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15b123-35e2-4ed9-a9f1-7375c83c7641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:25.065900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b123-35e2-4ed9-a9f1-7375c83c7641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:25.067482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15b123-35e2-4ed9-a9f1-7375c83c7641 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:25.079547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1403/2802] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:25.083890 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:25.094775 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a0153-7a5e-4744-9061-f7cbdcb4803e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:25.099365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:25.100098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:25.100345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:25.100571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] PATH_INFO: `/v3/projects/555129ea9a614b7681ea16e3a1e2426c/users/ba3b1e847e604720a35ebdc661eabaa7/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:25.103666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555129ea9a614b7681ea16e3a1e2426c, user_id=ba3b1e847e604720a35ebdc661eabaa7, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:25.105614 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:25.116733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1400/2803] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:25 2022] PUT /identity/v3/projects/555129ea9a614b7681ea16e3a1e2426c/users/ba3b1e847e604720a35ebdc661eabaa7/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:34:25.128895 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:25.129172 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:25.129438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:25.157859 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] MFA Rules not processed for user `ba3b1e847e604720a35ebdc661eabaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:25.159136 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:25.234269 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1404/2804] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:25.245885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:25.248051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:25.306705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af37ca6-9099-466b-855f-deef1a5ba652 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:25.310598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa6461c-9601-404f-b5ed-84bb870555f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:25.311188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6461c-9601-404f-b5ed-84bb870555f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:25.311464 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6461c-9601-404f-b5ed-84bb870555f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:25.311723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa6461c-9601-404f-b5ed-84bb870555f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:25.320750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6461c-9601-404f-b5ed-84bb870555f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:25.322170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa6461c-9601-404f-b5ed-84bb870555f9 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:25.331303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1401/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:25.427746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:25.438817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d519d-1026-44b7-8022-6b2e15839972 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:25.442533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:25.443129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:25.443399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:25.443662 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:25.502384 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:25.503825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:25.513312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1405/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:35.327245 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:35.509204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=92 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:39.750229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:39.750782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:39.750782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:39.771407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:39.772724 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:39.840249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1402/2807] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:34:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:39.894292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:39.904801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:39.906278 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:39.957422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd279ae6-5bff-4123-874d-4feb16665571 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:39.961853 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:39.962477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:39.962746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:39.963012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] PATH_INFO: `/v3/users/685eda43e91641d58689d5577d9711bb` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:39.964103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=685eda43e91641d58689d5577d9711bb)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:39.966067 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:39.987896 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f76e3-1f30-4ba5-b8f0-7af1328e379c None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:39.993131 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8059b16-d7fd-47a7-bc41-474a06de3337 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:39.993773 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059b16-d7fd-47a7-bc41-474a06de3337 service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:39.994047 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059b16-d7fd-47a7-bc41-474a06de3337 service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:39.994313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8059b16-d7fd-47a7-bc41-474a06de3337 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:40.003902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8059b16-d7fd-47a7-bc41-474a06de3337 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:40.005841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8059b16-d7fd-47a7-bc41-474a06de3337 service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:40.014924 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1403/2808] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:34:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 12:34:40.020545 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '685eda43e91641d58689d5577d9711bb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.032948 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '685eda43e91641d58689d5577d9711bb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.066368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '685eda43e91641d58689d5577d9711bb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.067703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '685eda43e91641d58689d5577d9711bb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.096400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '685eda43e91641d58689d5577d9711bb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.106290 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1406/2809] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:39 2022] DELETE /identity/v3/users/685eda43e91641d58689d5577d9711bb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:40.111808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:40.112127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:40.112372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:40.137434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:40.138573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:40.218240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1404/2810] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:40.228537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:40.230495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:40.294600 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6bff2-4891-465f-bcd9-3bf01139f3c9 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:40.298611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:40.299225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:40.299502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:40.299775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:40.312495 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:40.313942 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:40.324914 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1407/2811] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:34:40.625782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:40.627299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:40.639629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f48a8e-ecbe-4522-a29a-3b9d157a9ef8 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:40.659364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:40.660027 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:40.660337 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:40.660621 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] PATH_INFO: `/v3/projects/51bd10d4e93645afbe936b2288f5f153` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:40.662189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] RBAC: Authorizing `identity:delete_project(project_id=51bd10d4e93645afbe936b2288f5f153)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:40.664408 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:40.697381 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:40.729721 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51bd10d4e93645afbe936b2288f5f153', 'request_id': 'req-28ff6740-be20-4eee-8a1f-30142968403b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.736489 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51bd10d4e93645afbe936b2288f5f153', 'request_id': 'req-28ff6740-be20-4eee-8a1f-30142968403b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.744450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51bd10d4e93645afbe936b2288f5f153', 'request_id': 'req-28ff6740-be20-4eee-8a1f-30142968403b'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.762868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] The token cache is being invalidate because project 51bd10d4e93645afbe936b2288f5f153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:40.763531 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.764350 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.767523 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1405/2812] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:40 2022] DELETE /identity/v3/projects/51bd10d4e93645afbe936b2288f5f153 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:40.771283 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:40.784671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba120-528f-4ef9-a2be-0df85f07e4c5 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:40.809834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:40.867583 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:40.868360 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:40.868663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:40.868929 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] PATH_INFO: `/v3/users/ba3b1e847e604720a35ebdc661eabaa7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:40.870090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba3b1e847e604720a35ebdc661eabaa7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:40.877330 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:40.945742 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba3b1e847e604720a35ebdc661eabaa7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.957982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba3b1e847e604720a35ebdc661eabaa7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.967830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba3b1e847e604720a35ebdc661eabaa7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.969146 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba3b1e847e604720a35ebdc661eabaa7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.984750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-77777b2b-0669-4289-bd81-b3d6735a0f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba3b1e847e604720a35ebdc661eabaa7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:40.991625 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1408/2813] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:40 2022] DELETE /identity/v3/users/ba3b1e847e604720a35ebdc661eabaa7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:41.331568 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.333288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:41.353815 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff6740-be20-4eee-8a1f-30142968403b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.410553 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.411193 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.411455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.411719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] PATH_INFO: `/v3/projects/555129ea9a614b7681ea16e3a1e2426c` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.412975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=555129ea9a614b7681ea16e3a1e2426c)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.414850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.465092 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555129ea9a614b7681ea16e3a1e2426c', 'request_id': 'req-9f557181-10ff-4cd1-b481-a405d0f7aa1c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:41.470593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555129ea9a614b7681ea16e3a1e2426c', 'request_id': 'req-9f557181-10ff-4cd1-b481-a405d0f7aa1c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:41.476675 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555129ea9a614b7681ea16e3a1e2426c', 'request_id': 'req-9f557181-10ff-4cd1-b481-a405d0f7aa1c'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:41.493586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] The token cache is being invalidate because project 555129ea9a614b7681ea16e3a1e2426c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:41.493982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:41.495198 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-9f557181-10ff-4cd1-b481-a405d0f7aa1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:41.497438 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1406/2814] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:41 2022] DELETE /identity/v3/projects/555129ea9a614b7681ea16e3a1e2426c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:41.502738 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.502866 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.503125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.524730 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:41.525937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:41.586665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1409/2815] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:34:41.595168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.595452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.595719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.616279 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:41.617524 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:41.627002 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1407/2816] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:41.631655 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.642239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c74639-9a8f-4553-8dd3-693fc5eace17 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.648106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.648745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.649029 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.649289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.649926 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:34:41.650218 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.651803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.663769 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1410/2817] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:34:41.668244 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.678542 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae94b41-b93c-4199-8028-2d5c9450488f None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.684453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.685127 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.685462 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.685782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.686468 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.688471 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.719283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1408/2818] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:41 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:41.723530 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.733745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38833c-7286-4fdd-bf65-bf059a33a869 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.760161 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:41.791577 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.792148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.792478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.792741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.793359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.795350 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.819183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1411/2819] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:41 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:41.824241 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.839548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83013e97-d9f9-4cba-bdc3-c6879d51804d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.845428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.846026 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.846304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.846573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.847211 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.848853 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.850990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:41.861176 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1409/2820] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:41.865211 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.876980 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ea785-9e25-4450-8df7-a2fd5ea8eb4f admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.889877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deee84b-52a9-4662-a65d-512b0070fc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.890482 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee84b-52a9-4662-a65d-512b0070fc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.890764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee84b-52a9-4662-a65d-512b0070fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.891018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee84b-52a9-4662-a65d-512b0070fc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.891774 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee84b-52a9-4662-a65d-512b0070fc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.893399 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deee84b-52a9-4662-a65d-512b0070fc1c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.904970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1412/2821] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:34:41.909034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:41.919120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bc7dd-79f5-442b-89cf-6031c77d1640 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:41.924436 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:41.925168 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.925441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.925705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] PATH_INFO: `/v3/projects/fe43c079f58c4f49bc543eaae00ade2e/users/c27f50935c7043f6b0519550c44f7c71/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:41.941639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe43c079f58c4f49bc543eaae00ade2e, user_id=c27f50935c7043f6b0519550c44f7c71, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:41.944282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:41.959860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1410/2822] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:41 2022] PUT /identity/v3/projects/fe43c079f58c4f49bc543eaae00ade2e/users/c27f50935c7043f6b0519550c44f7c71/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:41.970637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:41.971175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:41.971306 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.000195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] MFA Rules not processed for user `c27f50935c7043f6b0519550c44f7c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:42.001477 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:42.068349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1413/2823] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:42.073088 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.137282 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b747eb-2497-4609-8111-1317e44c5c7d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.142490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.143094 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.143366 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.143628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.144348 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.146274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.177457 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1411/2824] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:34:42 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:42.181799 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.193274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24d4e-de2c-4174-bc4c-1c9b45b0fc78 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.257711 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.258315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.258585 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.258849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.259461 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.261390 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.286526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1414/2825] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:34:42 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:34:42.290678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.301722 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61059b51-035c-45a9-ba6c-1dfb37078a8f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.308145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.308790 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.309070 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.309332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.309974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.311676 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.323666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1412/2826] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:42.327949 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.339035 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221614f-b9e4-4e41-9bd0-1efd03ad7fe8 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.345848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.346514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.346785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.347028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] PATH_INFO: `/v3/projects/26c86d59d8e844e7acba0e874c04e420/users/a71794fb24574446b681580c33cbd32d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.365879 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c86d59d8e844e7acba0e874c04e420, user_id=a71794fb24574446b681580c33cbd32d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.369446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.386271 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1415/2827] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:42 2022] PUT /identity/v3/projects/26c86d59d8e844e7acba0e874c04e420/users/a71794fb24574446b681580c33cbd32d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:42.390592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.400903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6f507-ccf3-4d6f-990a-415dc6c2f0cc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.465332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3891437-cc01-4a62-9b50-c47cda725d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.466230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3891437-cc01-4a62-9b50-c47cda725d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.466624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3891437-cc01-4a62-9b50-c47cda725d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.467107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3891437-cc01-4a62-9b50-c47cda725d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.467885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3891437-cc01-4a62-9b50-c47cda725d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.470163 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3891437-cc01-4a62-9b50-c47cda725d80 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.480581 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1413/2828] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:34:42.485119 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.490797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:42.497014 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c2b18-23d4-4634-9cbc-d2029f3234b1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.503208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.503854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.504126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.504401 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] PATH_INFO: `/v3/projects/26c86d59d8e844e7acba0e874c04e420/users/a71794fb24574446b681580c33cbd32d/roles/1e154845d18647eaa8a61129c3419d62` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.506371 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26c86d59d8e844e7acba0e874c04e420, user_id=a71794fb24574446b681580c33cbd32d, role_id=1e154845d18647eaa8a61129c3419d62)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.509049 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.522623 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1416/2829] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:34:42 2022] PUT /identity/v3/projects/26c86d59d8e844e7acba0e874c04e420/users/a71794fb24574446b681580c33cbd32d/roles/1e154845d18647eaa8a61129c3419d62 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:42.535065 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.535347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.535608 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.564707 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] MFA Rules not processed for user `a71794fb24574446b681580c33cbd32d`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:42.565935 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:42.599580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:42.637297 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1414/2830] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:42.649025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:42.651171 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:42.717613 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a5a4c-836c-4c85-8255-ec5a0d3fb6e6 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:42.721553 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa83e03-a14d-4eeb-b4bf-53598ced9e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:42.722162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83e03-a14d-4eeb-b4bf-53598ced9e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:42.722438 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83e03-a14d-4eeb-b4bf-53598ced9e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:42.722707 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa83e03-a14d-4eeb-b4bf-53598ced9e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:42.732018 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83e03-a14d-4eeb-b4bf-53598ced9e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:42.733604 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa83e03-a14d-4eeb-b4bf-53598ced9e38 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:42.743143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1417/2831] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:43.162863 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:43.226666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b52e7-af2f-4f0e-837c-f42c9e1a31a2 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:43.231831 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:43.232473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:43.232750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:43.233048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] PATH_INFO: `/v3/users/c27f50935c7043f6b0519550c44f7c71` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:43.234361 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27f50935c7043f6b0519550c44f7c71)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:43.236257 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:43.292610 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27f50935c7043f6b0519550c44f7c71'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.302108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27f50935c7043f6b0519550c44f7c71'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.302742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27f50935c7043f6b0519550c44f7c71'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.315118 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27f50935c7043f6b0519550c44f7c71'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.315748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27f50935c7043f6b0519550c44f7c71'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.327344 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1415/2832] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:43 2022] DELETE /identity/v3/users/c27f50935c7043f6b0519550c44f7c71 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:43.332118 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:43.332648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:43.332648 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:43.353131 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:43.354337 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:43.422074 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1418/2833] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:43.431968 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:43.433482 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:43.488342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:43.492703 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f537cd-9b7c-4be3-bd26-bf4f8f1d5466 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:43.498144 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:43.498959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:43.499641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:43.499912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:43.509932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:43.511358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:43.521299 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1416/2834] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:34:43.810427 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:43.812025 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:43.829247 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b1247-4c4c-488e-b21c-67bb4bc3d325 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:43.834830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:43.835637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:43.836026 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:43.836440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] PATH_INFO: `/v3/projects/fe43c079f58c4f49bc543eaae00ade2e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:43.837805 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe43c079f58c4f49bc543eaae00ade2e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:43.839986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:43.888465 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe43c079f58c4f49bc543eaae00ade2e', 'request_id': 'req-887ff900-efcb-4f87-aa24-96eb9330aacb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.894547 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe43c079f58c4f49bc543eaae00ade2e', 'request_id': 'req-887ff900-efcb-4f87-aa24-96eb9330aacb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.900794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe43c079f58c4f49bc543eaae00ade2e', 'request_id': 'req-887ff900-efcb-4f87-aa24-96eb9330aacb'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.915288 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] The token cache is being invalidate because project fe43c079f58c4f49bc543eaae00ade2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:43.915572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.916187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:43.917803 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1419/2835] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:43 2022] DELETE /identity/v3/projects/fe43c079f58c4f49bc543eaae00ade2e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:43.922219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:43.932319 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c775f2f-7fdd-466e-ae5d-f70699121435 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:44.000170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:44.001398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:44.001766 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:44.002190 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] PATH_INFO: `/v3/users/a71794fb24574446b681580c33cbd32d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:44.004018 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71794fb24574446b681580c33cbd32d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:44.006926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:44.074473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71794fb24574446b681580c33cbd32d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.086138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71794fb24574446b681580c33cbd32d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.087082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71794fb24574446b681580c33cbd32d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.103932 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71794fb24574446b681580c33cbd32d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.104655 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-27fdd5cc-840d-4506-b146-5a9fb90304f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71794fb24574446b681580c33cbd32d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.120994 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1417/2836] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:34:43 2022] DELETE /identity/v3/users/a71794fb24574446b681580c33cbd32d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:44.465386 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:44.466884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:44.492064 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ff900-efcb-4f87-aa24-96eb9330aacb admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:44.520854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:44.580428 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:44.581132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:44.581576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:44.581817 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] PATH_INFO: `/v3/projects/26c86d59d8e844e7acba0e874c04e420` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:44.583133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26c86d59d8e844e7acba0e874c04e420)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:44.585273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:44.638663 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26c86d59d8e844e7acba0e874c04e420', 'request_id': 'req-d9abc5f8-6d7e-4774-938e-79df6d9bc926'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.645526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26c86d59d8e844e7acba0e874c04e420', 'request_id': 'req-d9abc5f8-6d7e-4774-938e-79df6d9bc926'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.652641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26c86d59d8e844e7acba0e874c04e420', 'request_id': 'req-d9abc5f8-6d7e-4774-938e-79df6d9bc926'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.671304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] The token cache is being invalidate because project 26c86d59d8e844e7acba0e874c04e420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:34:44.671603 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.672314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:34:44.674198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1420/2837] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:34:44 2022] DELETE /identity/v3/projects/26c86d59d8e844e7acba0e874c04e420 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:34:54.114259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:54.667148 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:34:58.036563 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:58.037142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:58.037142 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:58.060976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:34:58.062202 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:58.130808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1418/2838] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 9 12:34:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:34:58.147638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:34:58.149343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:34:58.249421 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abc5f8-6d7e-4774-938e-79df6d9bc926 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:34:58.256996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:34:58.257608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:34:58.257882 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:34:58.258143 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:34:58.269185 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:34:58.270787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:34:58.281195 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1421/2839] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:34:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:35:00.281714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:00.283939 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:00.353736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:00.356192 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:00.359598 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4c681-e47f-4f54-99dc-cd7b831ccfa6 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:00.366443 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:00.367342 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:00.367708 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:00.368429 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:00.370171 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:00.385683 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:00.387742 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:00.401011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1419/2840] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:35:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:35:00.438440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a3321-d914-4e7f-bf6e-9942c67a560b service swift] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:00.443187 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:00.444082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:00.444362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:00.444665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] PATH_INFO: `/v3/users/e9f9a02ea89f4991a3042c14cf869432` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:00.445830 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f9a02ea89f4991a3042c14cf869432)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:00.447773 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:00.505169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f9a02ea89f4991a3042c14cf869432'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.515215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f9a02ea89f4991a3042c14cf869432'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.523357 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f9a02ea89f4991a3042c14cf869432'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.524225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f9a02ea89f4991a3042c14cf869432'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.537268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2161c605-d671-4085-82ee-b94be3795993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f9a02ea89f4991a3042c14cf869432'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.543901 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1422/2841] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:35:00 2022] DELETE /identity/v3/users/e9f9a02ea89f4991a3042c14cf869432 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:35:00.737296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:00.748467 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2530420-80ed-4c46-9ea5-f2a345a5c436 service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:00.817402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:00.818039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:00.818322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:00.818591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] PATH_INFO: `/v3/projects/f461ddd7986842159c8e8177a7825435` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:00.819732 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f461ddd7986842159c8e8177a7825435)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:00.821697 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:00.873704 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:00.887042 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f461ddd7986842159c8e8177a7825435', 'request_id': 'req-ba74ca94-6a77-4dc6-b64f-463628a037e2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.893785 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f461ddd7986842159c8e8177a7825435', 'request_id': 'req-ba74ca94-6a77-4dc6-b64f-463628a037e2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.900069 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f461ddd7986842159c8e8177a7825435', 'request_id': 'req-ba74ca94-6a77-4dc6-b64f-463628a037e2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.918303 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] The token cache is being invalidate because project f461ddd7986842159c8e8177a7825435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:35:00.918690 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.919720 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-ba74ca94-6a77-4dc6-b64f-463628a037e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:00.922194 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1420/2842] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:35:00 2022] DELETE /identity/v3/projects/f461ddd7986842159c8e8177a7825435 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:35:00.929514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:00.929886 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:00.930258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:00.954208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:00.956219 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:00.960910 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:01.020966 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1423/2843] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:01.031576 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.031894 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.032159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.052419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:01.053678 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:01.063051 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1421/2844] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:01.067783 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.077976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d605083-478e-4a67-a307-fecdc9b6153d None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.083638 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.084233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.084593 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.084854 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.085502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:35:01.085809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.087468 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.100256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1424/2845] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:35:01.104794 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.114750 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c443-85fd-489d-b1bc-5517d704fd07 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.119879 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.120510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.120772 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.121039 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.121654 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.123910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.153356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1422/2846] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:35:01 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:35:01.158586 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.169609 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821543e-eed4-41c4-8c99-06acc41dd4f7 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.229378 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.229986 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.230258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.230549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.231157 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.233120 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.257675 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1425/2847] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:35:01 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:35:01.262901 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.273677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354b74a-723d-4774-b1ee-bfc5e45b759d admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.278835 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.279424 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.279699 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.279964 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.280626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.282219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.292788 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1423/2848] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 12:35:01.296970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.307748 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5c06-aeb3-4cf3-92ca-203478fdffaa admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.313039 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432365a-6303-43c6-b34d-6328f0f898e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.313636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432365a-6303-43c6-b34d-6328f0f898e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.313908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432365a-6303-43c6-b34d-6328f0f898e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.314159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432365a-6303-43c6-b34d-6328f0f898e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.314813 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432365a-6303-43c6-b34d-6328f0f898e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.316487 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432365a-6303-43c6-b34d-6328f0f898e8 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.326952 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1426/2849] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:35:01.331120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.341235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be8c95-bf80-4b3b-82f3-148dcaa93995 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.346446 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.347095 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.347372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.347642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] PATH_INFO: `/v3/projects/62f0751d26d64c38bc3bc67b1f7e3caa/users/0831dbfc52a7400ca472e1286372b68d/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.370860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0751d26d64c38bc3bc67b1f7e3caa, user_id=0831dbfc52a7400ca472e1286372b68d, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.373927 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.389910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1424/2850] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:35:01 2022] PUT /identity/v3/projects/62f0751d26d64c38bc3bc67b1f7e3caa/users/0831dbfc52a7400ca472e1286372b68d/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:35:01.407437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbe8c9-c227-45d8-adf5-91485cad73e7 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.407932 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbe8c9-c227-45d8-adf5-91485cad73e7 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.408034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbe8c9-c227-45d8-adf5-91485cad73e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.442133 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-d6dbe8c9-c227-45d8-adf5-91485cad73e7 None None] MFA Rules not processed for user `0831dbfc52a7400ca472e1286372b68d`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:01.443356 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d6dbe8c9-c227-45d8-adf5-91485cad73e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:01.512115 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1427/2851] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:01.526382 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:01.529403 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:01.623285 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb05fe-3fef-4f10-a404-22521577b620 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:01.627236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf3acf73742b49409bfc4128386a3302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:01.627838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:01.628114 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:01.628407 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:01.639043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:01.641372 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:01.650745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1425/2852] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:35:11.508844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:11.646829 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=73,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:16.193455 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6377ce-5d10-4549-a46c-71ae0ad608fa None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:16.194043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6377ce-5d10-4549-a46c-71ae0ad608fa None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:16.194043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6377ce-5d10-4549-a46c-71ae0ad608fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:16.214474 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-ff6377ce-5d10-4549-a46c-71ae0ad608fa None None] MFA Rules not processed for user `1c6c4f7d2e6e42b38368cf3eaffc6187`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:16.215739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ff6377ce-5d10-4549-a46c-71ae0ad608fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:16.272994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1428/2853] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:26.265346 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=25 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:54.827723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:54.896419 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327832bf-b13b-4475-b72c-8b47aa01bc6d service glance] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:54.901545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:54.902175 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:54.902453 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:54.902725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] PATH_INFO: `/v3/users/0831dbfc52a7400ca472e1286372b68d` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:54.903892 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0831dbfc52a7400ca472e1286372b68d)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:54.905885 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:54.958132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0831dbfc52a7400ca472e1286372b68d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:54.967356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0831dbfc52a7400ca472e1286372b68d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:54.968009 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0831dbfc52a7400ca472e1286372b68d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:54.980035 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0831dbfc52a7400ca472e1286372b68d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:54.980702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0831dbfc52a7400ca472e1286372b68d'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:54.992934 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1426/2854] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:35:54 2022] DELETE /identity/v3/users/0831dbfc52a7400ca472e1286372b68d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:35:54.997626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:54.998138 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:54.998252 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.018304 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:55.019517 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:55.078810 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1429/2855] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:55.088840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.090402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:55.149165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dca4c-a0c0-4fe1-b95b-21d72db6cfff admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.153837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456f206-0200-4e87-bb5b-3241a36c78d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.154431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456f206-0200-4e87-bb5b-3241a36c78d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.154702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456f206-0200-4e87-bb5b-3241a36c78d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.154962 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456f206-0200-4e87-bb5b-3241a36c78d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.164669 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456f206-0200-4e87-bb5b-3241a36c78d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.166066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456f206-0200-4e87-bb5b-3241a36c78d0 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.175639 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1427/2856] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:35:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:35:55.455956 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.457645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:55.472844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9226cdd-04d1-4b35-929c-a9bcbc2c20d1 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.478831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.479857 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.480307 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.480852 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] PATH_INFO: `/v3/projects/62f0751d26d64c38bc3bc67b1f7e3caa` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.482695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f0751d26d64c38bc3bc67b1f7e3caa)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.486501 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.546989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f0751d26d64c38bc3bc67b1f7e3caa', 'request_id': 'req-2d87d25d-91cf-4735-b4e2-85d0db6cce54'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:55.552982 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f0751d26d64c38bc3bc67b1f7e3caa', 'request_id': 'req-2d87d25d-91cf-4735-b4e2-85d0db6cce54'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:55.559792 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f0751d26d64c38bc3bc67b1f7e3caa', 'request_id': 'req-2d87d25d-91cf-4735-b4e2-85d0db6cce54'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:55.575871 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] The token cache is being invalidate because project 62f0751d26d64c38bc3bc67b1f7e3caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:35:55.576152 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:55.576844 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-2d87d25d-91cf-4735-b4e2-85d0db6cce54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:35:55.578457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1430/2857] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:35:55 2022] DELETE /identity/v3/projects/62f0751d26d64c38bc3bc67b1f7e3caa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:35:55.583629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.583989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.584325 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.609078 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:55.610291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:55.628274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:55.673918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1428/2858] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:55.682409 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.682688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.682964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.706681 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:55.707934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:55.717012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1431/2859] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:35:55.721983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.731946 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4223ae-8930-4e51-9abc-21ad92900d45 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.738605 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.739208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.739470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.739735 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] PATH_INFO: `/v3/domains` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.740495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 12:35:55.740799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.742385 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.755818 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1429/2860] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 12:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 12:35:55.760024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.770275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe11f5-2733-4e49-8b61-4ec09d61c902 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.775069 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.775660 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.775933 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.776198 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] PATH_INFO: `/v3/projects` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.776863 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.778746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.811166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1432/2861] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 12:35:55 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 12:35:55.815547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.825862 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e501b5e-f06d-4fe2-a212-bafb5a4b622f admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.890959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.891591 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.891868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.892134 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.892800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.894765 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.917378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1430/2862] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 12:35:55 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 12:35:55.921682 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.932617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34233f09-88d4-425a-b5cc-45a0cac1b05c admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.938584 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.939179 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.939456 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.939734 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.940368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.941978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.955303 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1433/2863] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:35:55.956814 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:55.967360 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d538e-4aab-4022-85d5-4cde3dbbd2f4 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:55.972810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3bc73-b24a-465d-a4c4-9b13f496aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:55.973418 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bc73-b24a-465d-a4c4-9b13f496aaab admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:55.973686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bc73-b24a-465d-a4c4-9b13f496aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:55.973959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bc73-b24a-465d-a4c4-9b13f496aaab admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:55.974619 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3bc73-b24a-465d-a4c4-9b13f496aaab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:55.976219 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3bc73-b24a-465d-a4c4-9b13f496aaab admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:55.988150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1431/2864] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 12:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 12:35:55.992488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:56.003331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ee1ad-e46d-4307-880f-bab17af786cf admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:56.008345 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:56.009002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] REQUEST_METHOD: `PUT` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:56.009276 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:56.009541 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] PATH_INFO: `/v3/projects/8d213e4a7f904eb0b8a21baaeeb1c22a/users/57cccf3c12fa446ea861ff20a7fabf48/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:56.024529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d213e4a7f904eb0b8a21baaeeb1c22a, user_id=57cccf3c12fa446ea861ff20a7fabf48, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:56.027129 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:56.042754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1434/2865] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 12:35:55 2022] PUT /identity/v3/projects/8d213e4a7f904eb0b8a21baaeeb1c22a/users/57cccf3c12fa446ea861ff20a7fabf48/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:35:56.054437 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c142-cf29-49cc-a968-4843a2f97542 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:56.054719 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c142-cf29-49cc-a968-4843a2f97542 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:56.054992 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1c142-cf29-49cc-a968-4843a2f97542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:56.082693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-ece1c142-cf29-49cc-a968-4843a2f97542 None None] MFA Rules not processed for user `57cccf3c12fa446ea861ff20a7fabf48`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:56.083903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-ece1c142-cf29-49cc-a968-4843a2f97542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:56.146622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1432/2866] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 12:35:56.159775 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:35:56.162637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:56.188537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:35:56.225314 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66580c6d-b9f4-4938-acf9-8411b193007e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:35:56.230159 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:35:56.230824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:56.231130 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:56.231400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:56.241836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:35:56.243279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:35:56.253103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1435/2867] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:35:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:35:57.645636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:35:57.646215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:35:57.646215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:35:57.667055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] MFA Rules not processed for user `57cccf3c12fa446ea861ff20a7fabf48`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:35:57.668866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:35:57.681567 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1433/2868] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:36:02.235771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:36:02.237570 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:36:02.394836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c93634-28c9-405a-9e7f-85d3187f55d6 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:36:02.405153 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:36:02.406764 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:36:02.407229 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:36:02.408072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:36:02.413908 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:36:02.430109 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:36:02.432037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:36:02.446270 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1436/2869] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:36:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:36:07.660577 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:12.439850 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=51 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:36:56.385516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:36:56.387091 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:36:56.452965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960b3c5-8bbb-4749-b959-4158051e7da1 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:36:56.456830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:36:56.457445 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:36:56.457723 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:36:56.457988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:36:56.459912 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:36:56.474048 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:36:56.475473 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:36:56.486607 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1434/2870] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:36:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:36:57.591894 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:36:57.604671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189c816-b833-4866-bcfc-f055b189074d service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:36:57.609470 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:36:57.610139 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:36:57.610419 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:36:57.610692 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:36:57.612737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:36:57.629272 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:36:57.630708 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:36:57.642587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1437/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:36:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:37:06.481394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=26 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:06.703341 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:37:06.712517 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080bfe7-a32a-418f-9718-576026dd89b8 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:37:06.716138 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:37:06.716806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:37:06.717080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:37:06.717347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:37:06.719079 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:37:06.788624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:37:06.790223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:37:06.802984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1435/2872] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:37:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:37:06.920513 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:37:06.921973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:37:06.994112 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59371bd-6e75-425c-95ec-87243805559b service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:37:06.999632 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:37:07.001072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:37:07.001343 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:37:07.001610 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:37:07.003488 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:37:07.015833 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:37:07.017554 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:37:07.028206 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1438/2873] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:37:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 12:37:16.795837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=28 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:17.024090 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=38 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:37:54.780600 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:37:54.782784 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:37:54.799635 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5c783-b531-4ae5-a541-4c9ad37316c3 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:37:54.806284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:37:54.806903 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:37:54.807179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:37:54.807449 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:37:54.809447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:37:54.903838 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:37:54.905545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f4c2-0c28-4d9f-8b52-855c3c0e60c2 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:37:54.924803 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1436/2874] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:37:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:38:04.921702 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=41 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:10.149970 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:38:10.162527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35851224-25a4-4f9e-8933-9fd3bd12a208 service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:38:10.167880 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:38:10.168736 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:38:10.169052 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:38:10.169331 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:38:10.172533 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:38:10.187549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:38:10.189275 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:38:10.197574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1439/2875] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:38:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:38:18.984541 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:38:18.985208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:38:18.985208 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:38:19.007053 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:38:19.008304 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:38:19.074358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1437/2876] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:38:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:38:19.124141 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:38:19.125617 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:38:19.196994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2aaa5-484a-41b2-a330-8f7e49362b0a service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:38:19.202493 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcca19a-46bd-4269-aced-203c60f617cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:38:19.203094 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcca19a-46bd-4269-aced-203c60f617cf service swift] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:38:19.203362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcca19a-46bd-4269-aced-203c60f617cf service swift] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:38:19.203633 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcca19a-46bd-4269-aced-203c60f617cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:38:19.212819 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcca19a-46bd-4269-aced-203c60f617cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:38:19.214398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcca19a-46bd-4269-aced-203c60f617cf service swift] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:38:19.222424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1440/2877] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:38:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:38:29.067265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=25 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:38:29.219499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=38 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:07.100988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:39:07.111291 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b0684-17a9-47c7-9d77-1dc8160d0773 None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:39:07.115871 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:39:07.116502 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:07.116776 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:07.117045 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:07.118931 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:39:07.185046 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:39:07.186490 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:39:07.195755 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1438/2878] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:39:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:39:07.550808 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188c24-8350-4e93-9511-2cab37f7ef4c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:07.551396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188c24-8350-4e93-9511-2cab37f7ef4c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:07.551396 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22188c24-8350-4e93-9511-2cab37f7ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:07.572258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-22188c24-8350-4e93-9511-2cab37f7ef4c None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:39:07.573437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-22188c24-8350-4e93-9511-2cab37f7ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:39:07.582624 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1441/2879] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 9 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:39:07.594900 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:39:07.611602 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c804507-2d3b-4077-9f22-30e3effaa2b8 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:39:07.617662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:39:07.618266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:07.618537 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:07.618798 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:07.628236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:39:07.629846 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:39:07.638727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1439/2880] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:39:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:39:07.869640 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64018-b1d7-4c04-9a8e-51057432a88d None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:07.869921 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64018-b1d7-4c04-9a8e-51057432a88d None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:07.870188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc64018-b1d7-4c04-9a8e-51057432a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:07.890831 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-7bc64018-b1d7-4c04-9a8e-51057432a88d None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:39:07.892072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7bc64018-b1d7-4c04-9a8e-51057432a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:39:07.901024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1442/2881] 10.222.0.60 () {58 vars in 1009 bytes} [Tue Aug 9 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:39:07.913954 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:39:07.924926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde189b-03e3-4298-84b0-345dd89f8f01 service swift] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:39:07.931506 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:39:07.932105 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:07.932406 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:07.932666 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:07.941005 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:39:07.942642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:39:07.950709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1440/2882] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:39:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:39:14.684920 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:14.685452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:14.685571 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:14.705368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] MFA Rules not processed for user `8ea2a62cdced4ef3b68868101b3c3dae`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:39:14.706560 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:39:14.714537 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1443/2883] 10.222.0.60 () {58 vars in 967 bytes} [Tue Aug 9 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:39:14.726841 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:39:14.738696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507085a-7df4-4d82-854b-694020fb1e5a service swift] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:39:14.744860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830103-f821-43be-9418-7778356750c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f3b5cb27f7e64ea1b3a04dc71d1d36aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:39:14.745451 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830103-f821-43be-9418-7778356750c1 service swift] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:39:14.745728 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830103-f821-43be-9418-7778356750c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:39:14.745993 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48830103-f821-43be-9418-7778356750c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:39:14.755322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830103-f821-43be-9418-7778356750c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:39:14.756915 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48830103-f821-43be-9418-7778356750c1 service swift] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:39:14.764933 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1441/2884] 10.222.0.60 () {60 vars in 1384 bytes} [Tue Aug 9 12:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 12:39:24.699888 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=9 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:39:24.762017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=46 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:07.490968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:41:07.520824 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc70f61-569d-4fc9-afb5-410bea4404ae None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:41:07.527464 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:41:07.527717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:41:07.528021 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:41:07.528549 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:41:07.556228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:41:07.558207 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:41:07.570598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1444/2885] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:41:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:41:17.565354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=17 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:41:56.609043 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830103-f821-43be-9418-7778356750c1 service swift] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:41:56.649558 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48830103-f821-43be-9418-7778356750c1 service swift] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:41:56.654209 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:41:56.654832 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:41:56.655098 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:41:56.655364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:41:56.681898 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:41:56.683331 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:41:56.706923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1442/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:41:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:41:58.519526 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:41:58.530012 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5dc94-7e2e-4956-a859-8fe108a497a2 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:41:58.534309 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:41:58.534943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:41:58.535239 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:41:58.535478 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:41:58.547004 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:41:58.548414 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:41:58.560043 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1445/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:41:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:42:06.703545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=28 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:07.452076 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:42:07.467440 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01b33e-f603-48b8-af26-c75b7be98d89 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:42:07.475417 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:42:07.476028 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:42:07.476296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:42:07.476588 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:42:07.486746 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:42:07.488352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:42:07.528434 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1443/2888] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:42:08.554740 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:17.522733 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=13 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:42:19.617747 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:42:19.619543 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:42:19.669426 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100fabc2-b478-4a2f-b838-127c4e09fbdf service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:42:19.675973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:42:19.676611 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:42:19.676869 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:42:19.677160 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:42:19.686070 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:42:19.687656 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:42:19.697809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1446/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:42:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:42:29.693746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=19 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:07.927763 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:07.952162 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6e64-759c-49ef-86cc-a8b1ee7d1b56 service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:07.956578 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:07.957180 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:07.957450 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:07.957709 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:07.967197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:07.968827 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:07.977872 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1444/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:43:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:43:08.372985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:08.374927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:08.400937 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e196b7-f984-44f6-9fc5-98757828d19f service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:08.405054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:08.405822 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:08.406103 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:08.406374 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:08.408166 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:08.492041 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:08.493518 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:08.512883 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1447/2891] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:43:11.946214 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:11.959119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4771738-805b-4e3c-a43f-dfcf68c8a396 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:11.965481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:11.966100 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:11.966441 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:11.966710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:11.968961 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:11.983378 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:11.985240 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:11.996521 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1445/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:43:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:43:14.992797 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:14.994292 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:15.007440 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f6e71-40b0-4243-9aeb-2288425011dd service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:15.016173 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:15.016855 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:15.017127 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:15.017393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] PATH_INFO: `/v3/users/72593249ee4843e9bb3ae413bfccf8b7` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:15.031962 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=72593249ee4843e9bb3ae413bfccf8b7)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:15.033964 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:15.082731 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72593249ee4843e9bb3ae413bfccf8b7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.091928 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72593249ee4843e9bb3ae413bfccf8b7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.099683 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72593249ee4843e9bb3ae413bfccf8b7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.100354 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72593249ee4843e9bb3ae413bfccf8b7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.111976 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72593249ee4843e9bb3ae413bfccf8b7'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.118165 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1448/2893] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:43:14 2022] DELETE /identity/v3/users/72593249ee4843e9bb3ae413bfccf8b7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:43:15.303714 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:15.315965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53af715-5c0d-44ae-82b2-b088c0774dd0 service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:15.374731 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:15.375497 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:15.375830 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:15.376158 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] PATH_INFO: `/v3/projects/bc3caeb344224a6b9ead2052d0b44909` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:15.377390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc3caeb344224a6b9ead2052d0b44909)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:15.379748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:15.427959 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc3caeb344224a6b9ead2052d0b44909', 'request_id': 'req-0872d27b-960d-4971-93e0-5f371594328e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.433269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc3caeb344224a6b9ead2052d0b44909', 'request_id': 'req-0872d27b-960d-4971-93e0-5f371594328e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.439629 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc3caeb344224a6b9ead2052d0b44909', 'request_id': 'req-0872d27b-960d-4971-93e0-5f371594328e'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.453474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] The token cache is being invalidate because project bc3caeb344224a6b9ead2052d0b44909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:43:15.453810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.454359 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.455852 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1446/2894] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:43:15 2022] DELETE /identity/v3/projects/bc3caeb344224a6b9ead2052d0b44909 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:43:15.459991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:15.461471 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:15.474977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b61ce7-55e3-4278-b9dc-fc71457018ab admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:15.487728 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:15.537776 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:15.538403 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:15.538672 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:15.538939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] PATH_INFO: `/v3/users/327c77db1d2241c7a96036e7eaf51307` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:15.552641 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327c77db1d2241c7a96036e7eaf51307)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:15.554559 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:15.602701 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327c77db1d2241c7a96036e7eaf51307'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.612291 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327c77db1d2241c7a96036e7eaf51307'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.619519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327c77db1d2241c7a96036e7eaf51307'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.620169 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327c77db1d2241c7a96036e7eaf51307'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.632398 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327c77db1d2241c7a96036e7eaf51307'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.638267 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1449/2895] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:43:15 2022] DELETE /identity/v3/users/327c77db1d2241c7a96036e7eaf51307 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 12:43:15.827231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:15.828758 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:15.841713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872d27b-960d-4971-93e0-5f371594328e admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:15.897889 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:15.906132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:15.907084 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:15.907658 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:15.908109 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] PATH_INFO: `/v3/projects/84bbe7b097cf4b02a2511e0839c95d02` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:15.919191 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=84bbe7b097cf4b02a2511e0839c95d02)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:15.921430 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:15.971800 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84bbe7b097cf4b02a2511e0839c95d02', 'request_id': 'req-5e661ddb-829e-4521-b2b5-8c1744f2fddc'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.977843 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84bbe7b097cf4b02a2511e0839c95d02', 'request_id': 'req-5e661ddb-829e-4521-b2b5-8c1744f2fddc'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.984867 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84bbe7b097cf4b02a2511e0839c95d02', 'request_id': 'req-5e661ddb-829e-4521-b2b5-8c1744f2fddc'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:15.999133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] The token cache is being invalidate because project 84bbe7b097cf4b02a2511e0839c95d02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:43:15.999420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:16.000055 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:43:16.001623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1447/2896] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:43:15 2022] DELETE /identity/v3/projects/84bbe7b097cf4b02a2511e0839c95d02 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:43:23.334536 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:43:23.336233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:23.405840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04e45a-8ec2-4f3e-8e58-5c717b53ff83 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:43:23.452840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:23.466351 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:43:23.466960 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:43:23.467237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:43:23.467508 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:43:23.469315 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:43:23.478697 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:43:23.480158 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:43:23.488702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1450/2897] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:43:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:43:25.996112 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:43:33.485011 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=8 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:44:08.139717 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:44:08.142136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:44:08.238974 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e661ddb-829e-4521-b2b5-8c1744f2fddc admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:44:08.245580 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:44:08.246189 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:44:08.246463 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:44:08.246727 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:44:08.248662 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:44:08.347569 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:44:08.349229 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:44:08.369264 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1448/2898] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:44:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:44:18.366458 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=74 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:47:08.449499 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:47:08.450974 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:08.521658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e116a7-add2-4272-b137-99d2e2800037 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:47:08.525411 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:47:08.526005 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:47:08.526278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:47:08.526548 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:47:08.528274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:08.608178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:47:08.609688 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:47:08.628097 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1451/2899] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:47:08.659549 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:47:08.669906 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d1fd2-9dbd-4662-b436-3fe83e342e38 service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:47:08.674529 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:47:08.675119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:47:08.675393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:47:08.675661 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:47:08.677512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:08.691140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:47:08.692593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:47:08.705103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1449/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:47:08.798741 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:47:08.807794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171bad1-420e-460e-8964-2cc19a0994bb service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:47:08.811989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:47:08.812658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:47:08.813008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:47:08.813274 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:47:08.815246 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:08.830320 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:47:08.831739 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:47:08.843037 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1452/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:47:15.259534 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:47:15.260975 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:15.271554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e181d99-8559-42d3-88fc-064244daffab service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:47:15.275393 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:47:15.275982 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:47:15.276265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:47:15.276551 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:47:15.278327 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] Could not find project: bc3caeb344224a6b9ead2052d0b44909.: keystone.exception.ProjectNotFound: Could not find project: bc3caeb344224a6b9ead2052d0b44909. Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 09 12:47:15.308860 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:47:15.311128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self._validate_token_resources() Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 12:47:15.313547 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application with Lock( Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._enter() Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.creator() Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application created_value = creator( Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 12:47:15.316120 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 12:47:15.318705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bc3caeb344224a6b9ead2052d0b44909. Aug 09 12:47:15.318705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: ERROR keystone.server.flask.application Aug 09 12:47:15.318705 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1450/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:47:15 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 09 12:47:18.838024 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=72 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:47:20.573709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:47:20.575263 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:20.648175 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9babce-64b3-46f2-bcf9-4baea4a444ff service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:47:20.654827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:47:20.655433 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:47:20.655709 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:47:20.655978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:47:20.657804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:47:20.670408 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:47:20.671977 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:47:20.682673 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1453/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:47:25.282145 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=10 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:47:30.678258 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=32 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:48:07.561540 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:48:07.574801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371d058-bbcd-4d41-813e-7be8bbd4e127 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:48:07.579405 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:48:07.579995 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:48:07.580265 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:48:07.580571 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:48:07.582716 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:48:07.672693 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:48:07.674132 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:48:07.693812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1451/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:48:17.691428 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=41 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:48:29.302936 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:48:29.305278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:48:29.321825 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87072183-6e08-4316-b6af-024c4b425bf6 service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:48:29.326521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:48:29.327162 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:48:29.327436 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:48:29.327698 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:48:29.335665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:48:29.337208 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:48:29.346231 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1454/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:48:39.342594 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:49:08.648696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:49:08.654231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc022f3-9384-4b21-b1e2-9554df5cc7f3 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:49:08.658573 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:49:08.659205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:49:08.659499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:49:08.659744 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:49:08.669677 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:49:08.672976 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:49:08.682988 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1452/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:49:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:49:18.678150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:52:09.100019 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:52:09.121053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f2500-4b57-41d7-8a76-b11c3fc476d7 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:52:09.126126 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:52:09.126722 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:52:09.126996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:52:09.127369 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:52:09.152114 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:52:09.153540 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:52:09.165417 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1455/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:52:19.159565 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=17 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:52:25.650736 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:52:25.652748 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:52:25.749999 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed68191-00ba-4f1e-b38d-c8299f276455 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:52:25.759452 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:52:25.760306 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:52:25.760743 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:52:25.761089 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:52:25.772942 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:52:25.774554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:52:25.784752 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1453/2908] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:52:35.780216 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=37 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:07.868079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:53:07.877834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653c689-adcc-4e80-9f25-04879ee81caa service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:53:07.881649 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:53:07.882243 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:07.882516 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:07.882788 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:07.893111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:53:07.894551 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:53:07.904273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1456/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:53:10.165133 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:53:10.186225 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba88b8-5cc0-4859-a020-d1de865bca5f service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:53:10.190715 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:53:10.191311 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:10.191586 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:10.191849 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:10.210205 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:53:10.211631 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:53:10.233480 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1454/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:53:11.425110 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:53:11.435753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8747c-5186-496e-8280-2a95b3de10fb service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:53:11.439836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8405-30fd-4614-b817-11ed47feef90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:53:11.440449 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8405-30fd-4614-b817-11ed47feef90 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:11.440726 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8405-30fd-4614-b817-11ed47feef90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:11.440991 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8405-30fd-4614-b817-11ed47feef90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:11.452602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a8405-30fd-4614-b817-11ed47feef90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:53:11.454044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a8405-30fd-4614-b817-11ed47feef90 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:53:11.465442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1457/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:53:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:53:15.320990 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:53:15.322526 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:53:15.419503 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eff0ff-44b0-47dc-9747-e29f503d293a service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:53:15.424633 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:53:15.425260 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:15.425510 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:15.425801 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] PATH_INFO: `/v3/users/57cccf3c12fa446ea861ff20a7fabf48` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:15.426967 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cccf3c12fa446ea861ff20a7fabf48)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:53:15.428937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:53:15.487513 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cccf3c12fa446ea861ff20a7fabf48'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:15.499080 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cccf3c12fa446ea861ff20a7fabf48'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:15.500077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cccf3c12fa446ea861ff20a7fabf48'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:15.518312 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cccf3c12fa446ea861ff20a7fabf48'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:15.519011 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cccf3c12fa446ea861ff20a7fabf48'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:15.531185 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1455/2912] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 12:53:15 2022] DELETE /identity/v3/users/57cccf3c12fa446ea861ff20a7fabf48 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:53:15.535829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:15.536318 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:15.536443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:15.565634 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 12:53:15.566849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:53:15.629968 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1458/2913] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 12:53:15.641642 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:53:15.643937 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:53:15.665215 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:15.733643 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e3178-d345-4af6-93b3-5a4b66ca255b admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:53:15.737997 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:53:15.738799 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:15.739071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:15.739332 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:15.749837 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:53:15.751283 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:53:15.762230 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1456/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:53:15.944793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:53:15.946305 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:53:15.959754 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd07ad0-c64a-4eaf-9e37-3fd804cfc1ce None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:53:15.964626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:53:15.965329 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:53:15.965598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:53:15.965829 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] PATH_INFO: `/v3/projects/8d213e4a7f904eb0b8a21baaeeb1c22a` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:53:15.967238 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d213e4a7f904eb0b8a21baaeeb1c22a)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:53:15.969710 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:53:16.029602 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'request_id': 'req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:16.036658 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'request_id': 'req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:16.046519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d213e4a7f904eb0b8a21baaeeb1c22a', 'request_id': 'req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:16.066905 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] The token cache is being invalidate because project 8d213e4a7f904eb0b8a21baaeeb1c22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 12:53:16.067234 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:16.068253 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 12:53:16.069985 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1459/2915] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 12:53:15 2022] DELETE /identity/v3/projects/8d213e4a7f904eb0b8a21baaeeb1c22a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 12:53:25.756810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=25 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:53:26.061099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:09.743313 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:54:09.745560 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:54:09.841292 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd253b0-ca38-44ba-b6fc-cfa13b4e19f7 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:54:09.908224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:54:09.908847 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:54:09.909119 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:54:09.909383 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:54:09.911538 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:54:09.994034 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:54:09.995559 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:54:10.005972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=100 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:10.015269 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1457/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:54:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:54:20.013093 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=2 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:54:35.284111 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:54:35.285832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:54:35.346955 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f9e8a-3cfb-4826-b17b-1b3c59d6796e admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:54:35.350840 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:54:35.351442 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:54:35.351718 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:54:35.351984 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:54:35.353874 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:54:35.363753 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:54:35.365205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:54:35.374099 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1460/2917] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:54:45.369647 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=26 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:09.037113 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:55:09.039014 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:55:09.053116 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b808-5991-4dd9-bf7c-01ab48edd01c service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:55:09.058972 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:55:09.059726 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:55:09.060003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:55:09.060261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:55:09.062470 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:55:09.075663 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:55:09.077263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:55:09.088222 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1458/2918] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:55:10.907289 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:55:10.923787 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c5f99-1233-41b4-81be-f146f11a4a40 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:55:10.930563 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:55:10.931176 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:55:10.931452 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:55:10.931717 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:55:10.934606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:55:10.948498 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:55:10.950532 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:55:10.962544 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1461/2919] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:55:19.083782 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:55:20.957106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=6 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:57:26.548201 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:57:26.549929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:57:26.632336 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886d18-e0a6-4233-8187-6d40ddf484c7 service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:57:26.638983 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:57:26.639593 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:57:26.639868 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:57:26.640143 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:57:26.642179 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:57:26.654197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:57:26.655768 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:57:26.666155 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1459/2920] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:57:36.661850 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=32 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:08.065107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:58:08.066814 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:58:08.082116 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764925a2-e1b3-42fb-9e16-5c26824aa1b6 service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:58:08.089695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:58:08.090327 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:58:08.090621 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:58:08.090897 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:58:08.093105 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:58:08.182519 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:58:08.184785 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:58:08.206028 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1462/2921] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:58:10.508981 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:58:10.519550 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd1478-1600-47ef-9e03-34ba3287f300 service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:58:10.523456 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:58:10.524054 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:58:10.524322 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:58:10.524628 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:58:10.526592 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:58:10.541139 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:58:10.542533 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:58:10.553481 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1460/2922] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:58:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:58:12.029077 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:58:12.039224 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4721-6312-4920-b043-c2fa86d394be service nova] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:58:12.043422 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:58:12.044015 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:58:12.044284 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:58:12.044576 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:58:12.046431 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 12:58:12.059994 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:58:12.061434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:58:12.072349 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1463/2923] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:58:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:58:20.548918 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:58:22.067745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=47 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 12:59:10.272040 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 12:59:10.284364 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a89e-142b-495a-ad64-f1e3afa293f5 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 12:59:10.291431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d6406240f104443b75c8ec7d7999070', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 12:59:10.292020 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 12:59:10.292296 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 12:59:10.292585 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 12:59:10.301136 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 12:59:10.302730 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 12:59:10.312505 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1461/2924] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 12:59:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 12:59:20.308203 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=6 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:02:33.591521 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:02:33.593302 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:02:33.682737 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e349fc-d218-44f0-905f-bd88a3ef2842 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:02:33.688652 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:02:33.689228 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:02:33.689502 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:02:33.689770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:02:33.698434 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:02:33.700002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:02:33.710002 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1464/2925] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:02:43.705938 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=37 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:03:11.489984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:03:11.491623 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:03:11.592266 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca5899-44a5-4c61-b375-609dd7ba9e0c service nova] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:03:11.596745 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:03:11.597352 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:03:11.597624 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:03:11.597887 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:03:11.607086 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:03:11.608626 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:03:11.618288 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1462/2926] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:03:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:03:21.613973 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=40 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:05:11.747954 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:05:11.750106 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:05:11.768703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24491fc-3b3d-4041-807a-5b5a9129070e service placement] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:05:11.777618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:05:11.777618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:05:11.777618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:05:11.777618 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:05:11.778177 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:05:11.828710 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:05:11.842905 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbd9d5-f4b7-4031-adf9-2afc47601852 service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:05:11.847347 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:05:11.847960 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:05:11.848234 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:05:11.848562 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:05:11.850545 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:05:11.868827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:05:11.870978 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:05:11.891870 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1465/2927] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:05:11.918574 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:05:11.920356 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:05:11.929512 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1463/2928] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:05:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:05:21.890265 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=41 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:05:21.925221 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=28 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:12.104082 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:12.105827 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:12.185864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ad0cb-ef17-4355-8a46-c70ad87e27c9 service cinder] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:12.190406 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:12.190996 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:12.191268 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:12.191529 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:12.193590 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:12.283443 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:12.284884 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:12.306233 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1466/2929] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:15.528150 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:15.539910 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c2023-5862-4c13-9164-1a13ae6d23bf service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:15.545159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:15.545839 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:15.546165 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:15.546483 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:15.548527 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:15.560126 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:15.561812 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:15.572780 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1464/2930] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:18.856514 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:18.858636 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:18.874342 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76deef-ccae-4844-ab94-d744cf55d820 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:18.879892 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:18.880900 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:18.881849 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:18.882125 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] PATH_INFO: `/v3/users/50fa6727271142eba979bb4562a2b853` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:18.883606 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fa6727271142eba979bb4562a2b853)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:18.886370 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:18.954091 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fa6727271142eba979bb4562a2b853'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:18.963696 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fa6727271142eba979bb4562a2b853'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:18.967053 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:18.982046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fa6727271142eba979bb4562a2b853'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:18.985637 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fa6727271142eba979bb4562a2b853'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.000959 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fa6727271142eba979bb4562a2b853'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.012273 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1467/2931] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 13:07:18 2022] DELETE /identity/v3/users/50fa6727271142eba979bb4562a2b853 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:19.196926 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:19.211725 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28f258-a8d1-4b6d-a699-a3939dcb6ee3 service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:19.280251 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:19.281071 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:19.281516 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:19.281810 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] PATH_INFO: `/v3/projects/602ad89c70da4ace9856766be19815a5` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:19.283188 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602ad89c70da4ace9856766be19815a5)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:19.285196 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:19.346499 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602ad89c70da4ace9856766be19815a5', 'request_id': 'req-039e8bc0-fcbe-498c-904e-4235967e8d35'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.354504 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602ad89c70da4ace9856766be19815a5', 'request_id': 'req-039e8bc0-fcbe-498c-904e-4235967e8d35'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.361003 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602ad89c70da4ace9856766be19815a5', 'request_id': 'req-039e8bc0-fcbe-498c-904e-4235967e8d35'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.377391 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] The token cache is being invalidate because project 602ad89c70da4ace9856766be19815a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 13:07:19.377596 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.378256 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.379808 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1465/2932] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 13:07:19 2022] DELETE /identity/v3/projects/602ad89c70da4ace9856766be19815a5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 13:07:19.384072 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:19.385534 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:19.399061 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24175e7-14bc-4f07-82bb-f12fab3cb8d1 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:19.463044 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:19.463679 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:19.463946 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:19.464237 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] PATH_INFO: `/v3/users/b5deaba3e7a04688b15ab6ac48ac0a42` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:19.479256 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5deaba3e7a04688b15ab6ac48ac0a42)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:19.481278 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:19.537582 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5deaba3e7a04688b15ab6ac48ac0a42'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.547989 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5deaba3e7a04688b15ab6ac48ac0a42'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.559794 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5deaba3e7a04688b15ab6ac48ac0a42'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.560523 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5deaba3e7a04688b15ab6ac48ac0a42'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.572758 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5deaba3e7a04688b15ab6ac48ac0a42'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.579746 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1468/2933] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 13:07:19 2022] DELETE /identity/v3/users/b5deaba3e7a04688b15ab6ac48ac0a42 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:19.764083 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:19.766455 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:19.788187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e8bc0-fcbe-498c-904e-4235967e8d35 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:19.854178 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:19.854822 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:19.855096 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:19.855365 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] PATH_INFO: `/v3/projects/5f348bffdeba4c2db9b383058a7514e5` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:19.867141 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f348bffdeba4c2db9b383058a7514e5)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:19.869227 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:19.894778 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:19.927066 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f348bffdeba4c2db9b383058a7514e5', 'request_id': 'req-a8620147-b6b7-4dfe-850b-69d4ab49e33a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.933170 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f348bffdeba4c2db9b383058a7514e5', 'request_id': 'req-a8620147-b6b7-4dfe-850b-69d4ab49e33a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.940978 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f348bffdeba4c2db9b383058a7514e5', 'request_id': 'req-a8620147-b6b7-4dfe-850b-69d4ab49e33a'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.954883 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] The token cache is being invalidate because project 5f348bffdeba4c2db9b383058a7514e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 13:07:19.955164 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.955866 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:19.957474 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1466/2934] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 13:07:19 2022] DELETE /identity/v3/projects/5f348bffdeba4c2db9b383058a7514e5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:26.699939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:26.702183 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:26.762550 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:26.780255 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0343da3-acfb-4f4f-b1a8-fe48f3da89f2 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:26.854834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:26.855444 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:26.856834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:26.857107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:26.860400 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:26.938432 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:26.939784 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:26.949546 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1469/2935] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:27.426495 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:27.428013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:27.479770 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:27.481279 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:27.495756 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bc291-a4fe-4596-b6af-83737b79c0e6 service neutron] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:27.500877 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:27.501572 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:27.501848 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:27.502079 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] PATH_INFO: `/v3/users/1c6c4f7d2e6e42b38368cf3eaffc6187` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:27.503225 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6c4f7d2e6e42b38368cf3eaffc6187)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:27.505204 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:27.506764 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8620147-b6b7-4dfe-850b-69d4ab49e33a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:27.512250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:27.513025 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:27.513326 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:27.513618 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:27.515409 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:27.527599 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:27.529305 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:27.539941 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1467/2936] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:27.565178 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6c4f7d2e6e42b38368cf3eaffc6187'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.574864 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6c4f7d2e6e42b38368cf3eaffc6187'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.582645 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6c4f7d2e6e42b38368cf3eaffc6187'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.583312 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6c4f7d2e6e42b38368cf3eaffc6187'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.596034 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-c2d219c4-339b-4b0a-bb56-836f7c6af522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6c4f7d2e6e42b38368cf3eaffc6187'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.602137 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1470/2937] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 13:07:27 2022] DELETE /identity/v3/users/1c6c4f7d2e6e42b38368cf3eaffc6187 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:27.784634 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:27.795275 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8cd20-1bd4-4bee-a5f3-3f1fe9f3fbdd service placement] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:27.853017 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:27.853644 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:27.853919 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:27.854187 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] PATH_INFO: `/v3/projects/e57ead005fcd46e4a751225d11d4f9e1` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:27.855320 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57ead005fcd46e4a751225d11d4f9e1)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:27.857263 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:27.895426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:27.909806 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57ead005fcd46e4a751225d11d4f9e1', 'request_id': 'req-689103fb-4621-4edf-a990-10ef97e060b2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.915130 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57ead005fcd46e4a751225d11d4f9e1', 'request_id': 'req-689103fb-4621-4edf-a990-10ef97e060b2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.921345 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57ead005fcd46e4a751225d11d4f9e1', 'request_id': 'req-689103fb-4621-4edf-a990-10ef97e060b2'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.937700 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] The token cache is being invalidate because project e57ead005fcd46e4a751225d11d4f9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 13:07:27.938128 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.939077 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-689103fb-4621-4edf-a990-10ef97e060b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:27.941358 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1468/2938] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 13:07:27 2022] DELETE /identity/v3/projects/e57ead005fcd46e4a751225d11d4f9e1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:27.947107 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:27.947842 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:27.947935 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:27.978765 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:28.014555 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 13:07:28.015868 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:28.078062 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1471/2939] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 13:07:28.086276 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.086548 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.086811 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.107363 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.auth.core [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 13:07:28.108583 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:28.117396 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1469/2940] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 13:07:28.122574 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.133836 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e59f2a-1d9e-4091-a262-68ce4530b56f None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.138651 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.139250 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.139527 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.139793 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.140437 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80178) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 13:07:28.140745 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.142368 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.154457 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1472/2941] 10.222.0.60 () {58 vars in 1153 bytes} [Tue Aug 9 13:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 13:07:28.159398 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.174447 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f56a30-d75b-4406-aaff-45aa38faeadd None None] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.183082 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.183902 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] REQUEST_METHOD: `POST` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.184272 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.184786 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] PATH_INFO: `/v3/projects` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.185696 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.188420 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.227566 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1470/2942] 10.222.0.60 () {60 vars in 1153 bytes} [Tue Aug 9 13:07:28 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 13:07:28.231951 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.242132 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7207e-80d9-4e60-920a-ee77098c5610 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.304076 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.304703 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.304983 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.305257 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.305875 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.307809 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.331891 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1473/2943] 10.222.0.60 () {60 vars in 1144 bytes} [Tue Aug 9 13:07:28 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 13:07:28.336181 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.347394 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06da49-86de-4087-80b8-595feea0148a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.353224 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.353824 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.354103 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.354343 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.354984 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.356622 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.367235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1471/2944] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 13:07:28.371762 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.382188 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3f55b-e711-453a-a036-fe97d9b804b4 admin admin] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.387771 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a303b2-55c2-476d-b2e9-991341958462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.388362 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a303b2-55c2-476d-b2e9-991341958462 admin admin] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.388665 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a303b2-55c2-476d-b2e9-991341958462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.388934 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a303b2-55c2-476d-b2e9-991341958462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.389598 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a303b2-55c2-476d-b2e9-991341958462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.391205 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a303b2-55c2-476d-b2e9-991341958462 admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.401927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1474/2945] 10.222.0.60 () {58 vars in 1122 bytes} [Tue Aug 9 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 13:07:28.406498 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.416584 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d3397-8071-4ed1-be8e-8039da1f6db3 admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.422392 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.422686 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] REQUEST_METHOD: `PUT` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.422965 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.423235 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] PATH_INFO: `/v3/projects/1d978724a75d43f19f4cb7d2f19af628/users/fa8ee2b025d54f7b8ce9719154a56783/roles/912a71be4e054ba7ad73b96d8a48412e` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.438261 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d978724a75d43f19f4cb7d2f19af628, user_id=fa8ee2b025d54f7b8ce9719154a56783, role_id=912a71be4e054ba7ad73b96d8a48412e)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.440925 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.456554 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1472/2946] 10.222.0.60 () {60 vars in 1483 bytes} [Tue Aug 9 13:07:28 2022] PUT /identity/v3/projects/1d978724a75d43f19f4cb7d2f19af628/users/fa8ee2b025d54f7b8ce9719154a56783/roles/912a71be4e054ba7ad73b96d8a48412e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:28.467446 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.467778 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.468054 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.498375 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] MFA Rules not processed for user `fa8ee2b025d54f7b8ce9719154a56783`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 13:07:28.499587 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:28.544671 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:28.576795 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1475/2947] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 13:07:28.588259 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:28.590354 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:28.649210 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8de2-68e8-443e-95ef-cecb5d7d987a admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:28.653231 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1157b842770470fb1bc61297ae0e2c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:28.653840 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:28.654107 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:28.654368 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:28.662864 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:28.664284 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:28.673250 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1473/2948] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:38.571695 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=7 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:38.669390 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=70,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:39.719818 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:39.721702 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:39.805496 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dd8f9-883c-494d-b299-05baa7445653 None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:39.811750 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:39.812359 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] REQUEST_METHOD: `GET` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:39.812693 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:39.812943 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:39.815046 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:39.827608 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:39.829215 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240431f-3e10-40f4-bd1b-dda10d9feb69 service placement] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:39.839373 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1476/2949] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:49.835203 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=32 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:07:51.319223 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:51.385641 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcd96ac-e80a-4857-9a65-2263d18668bc service cinder] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:51.390760 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:51.391395 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:51.391664 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:51.391923 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] PATH_INFO: `/v3/users/fa8ee2b025d54f7b8ce9719154a56783` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:51.393402 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8ee2b025d54f7b8ce9719154a56783)` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:51.395274 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:51.451836 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8ee2b025d54f7b8ce9719154a56783'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:51.461236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8ee2b025d54f7b8ce9719154a56783'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:51.461970 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8ee2b025d54f7b8ce9719154a56783'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:51.475373 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8ee2b025d54f7b8ce9719154a56783'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:51.476013 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.notifications [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8ee2b025d54f7b8ce9719154a56783'} {{(pid=80177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:51.488236 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1474/2950] 10.222.0.60 () {58 vars in 1224 bytes} [Tue Aug 9 13:07:51 2022] DELETE /identity/v3/users/fa8ee2b025d54f7b8ce9719154a56783 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:07:51.492939 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] REQUEST_METHOD: `POST` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:51.493451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:51.493451 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:51.515124 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.auth.core [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] MFA Rules not processed for user `881d465484874e7283e8dee880624ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80178) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 13:07:51.516719 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:51.577887 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1477/2951] 10.222.0.60 () {58 vars in 958 bytes} [Tue Aug 9 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 13:07:51.587881 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:51.589454 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:51.649159 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f3bb8-18de-42cc-895b-942e77a729dd admin admin] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:51.653565 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f2b2a5d05b545b28da423e872f47a10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:51.654161 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:51.654431 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:51.654695 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:51.664262 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:51.665689 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:51.675426 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1475/2952] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:07:51.957223 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] Authenticating user token {{(pid=80178) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:07:51.958834 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.fernet_utils [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80178) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:07:51.971878 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43103fbe-32f5-4809-844e-42dd6d77ed8c None None] Validating token access rules against request {{(pid=80178) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:07:51.977832 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '881d465484874e7283e8dee880624ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '865c26d1046a4242bbaffa7d1b6dfc7e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80178) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:07:51.978473 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:07:51.978743 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:07:51.979008 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] PATH_INFO: `/v3/projects/1d978724a75d43f19f4cb7d2f19af628` {{(pid=80178) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:07:51.981393 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d978724a75d43f19f4cb7d2f19af628)` {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:07:51.983626 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] RBAC: Authorization granted {{(pid=80178) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:07:52.045953 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d978724a75d43f19f4cb7d2f19af628', 'request_id': 'req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:52.053654 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d978724a75d43f19f4cb7d2f19af628', 'request_id': 'req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:52.062927 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d978724a75d43f19f4cb7d2f19af628', 'request_id': 'req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a'} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:52.078472 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] The token cache is being invalidate because project 1d978724a75d43f19f4cb7d2f19af628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80178) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 13:07:52.078804 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:52.079424 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG keystone.notifications [None req-cf6bb3b8-5f49-4b6c-9685-5dc5bda5da6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80178) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 13:07:52.080973 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: [pid: 80178|app: 0|req: 1478/2953] 10.222.0.60 () {58 vars in 1233 bytes} [Tue Aug 9 13:07:51 2022] DELETE /identity/v3/projects/1d978724a75d43f19f4cb7d2f19af628 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 13:08:01.671108 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:08:02.075480 dv-cinder-852369-1-iscsi devstack@keystone.service[80178]: DEBUG dbcounter [-] [80178] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80178) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 13:12:42.567140 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] Authenticating user token {{(pid=80177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 13:12:42.568929 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:12:42.728807 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901ad49-d9d9-4242-9bad-0f00498dccd8 service neutron] Validating token access rules against request {{(pid=80177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 13:12:42.803197 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be8c3d3074604b1181652ac0c346c906', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b62ad6eeb5e4d14b62d5ec4e233aafd', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 13:12:42.803713 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] REQUEST_METHOD: `GET` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 13:12:42.803987 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] SCRIPT_NAME: `/identity` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 13:12:42.804249 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 13:12:42.805989 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.fernet_utils [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 13:12:42.817771 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 13:12:42.819346 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03ebaa-8ffe-4b9d-a1d4-ed62e111f542 service placement] RBAC: Authorization granted {{(pid=80177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 13:12:42.832636 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: [pid: 80177|app: 0|req: 1476/2954] 10.222.0.60 () {60 vars in 1365 bytes} [Tue Aug 9 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 13:12:52.825152 dv-cinder-852369-1-iscsi devstack@keystone.service[80177]: DEBUG dbcounter [-] [80177] Writing DB stats keystone:SELECT=84 {{(pid=80177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}